I've heard a lot of such anecdotes. I'm not saying its ill-intentioned, but the skeptic in me is cautious that this is the type of reasoning which propels the anti-vax movement.
I wish / hope the medical community will address stories like this before people lose trust in them entirely. How frequent are mis-diagnosis like this? How often is "user research" helping or hurting the process of getting good health outcomes? Are there medical boards that are sending PSAs to help doctors improve common mis-diagnosis? Whats the role of LLMs in all of this?
> I wish / hope the medical community will address stories like this before people lose trust in them entirely.
Too late for me. I have a similar story. ChatGPT helped me diagnose an issue which I had been suffering with my whole life. I'm a new person now. GPs don't have the time to spend hours investigating symptoms for patients. ChatGPT can provide accurate diagnoses in seconds. These tools should be in wide use today by GPs. Since they refuse, patients will take matters into their own hands.
FYI, there are now studies showing ChatGPT outperforms doctors in diagnosis. (https://www.uvahealth.com/news/does-ai-improve-doctors-diagn...) I can believe it.
If you keep hearing anecdotes at what point is it statistically important ? IBM 15 years ago was selling a story about a search engine they created specifically for the medical field(they had it on jeopardy) where doctors spent 10 years before they figured this poor patients issue. They plugged the original doctors notes into it and the 4th result was the issue they took a decade to figure out. Memorizing dozens of medical books and being able to recall and correlate all that information in a human brain is a rare skill to be good at. The medical system works hard to ensure everyone going through can memorize but clearly search engines/llms can be a massive help here.
Every second doctor is a below average doctor. Some are outright idiots that just became doctors because their parents expected it of them. They somehow finished med school and now they sick at their job. Have you ever interacted with doctors? In a hospital rotation where you see a different one every week. And they all tell you entirely different things with absolute confidence of a prophet after looking at your file for 2 min and talking another 3?
Even good doctors have a real hard time convincing the bad doctors to do their job right. Never mind some random patient with a slightly less obvious diagnosis.
This is nothing like anti vax, because it is not implying a failing of medical science. It just states that enough doctors are bad enough at their job that user research is useful. To realize you need to go to a better doctor
> the skeptic in me is cautious that this is the type of reasoning which propels the anti-vax movement
I think there's a difference between questioning your doctor, and questioning advice given by almost every doctor. There are plenty of bad doctors out there, or maybe just doctors who are bad fits for their patients. They don't always listen or pay close attention to your history. And in spite of their education they don't always choose the correct diagnosis.
I also think there's an ever-increasing difference between AI health research and old-school WebMD research.
I also don't know. Additional point to consider: vast majority of doctors have no clue about Bayes theorem.
I can see why, but this is doc+patient in collab. And driven by using science in the form of applying llm-as-database-of-symptoms-and-treatments.
Anti-vax otoh is driven by ignorance and failure to trust science in the form of neither doctors, nor new types of science. Plus, anti-vax works like flat earth; a signaling mechanism of poor epostemic judgment."
I'm on some anti rejection meds post-transplant and chatgptd some of my symptoms and it said they were most likely caused by my meds. Two different nephrologists told me that the meds I'm on didn't cause those symptoms before looking it up themselves and confirming they do. I think LLMs have a place in this as far as being able to quick come up with hyphotesese that can be looked into and confirmed/disproved. If I hadn't had chatGPT, I wouldnt have brought it or my team would have just blamed lifestyle rather than meds.
Linking this anecdote to anti-vaxxing really seems a stretch, and I would like to see the reasoning behind that. My impression is that anti-vaxxers have more issues with vaccines themselves than with doctors who recommend them
The fact is that many doctors do suck. Nearly all of my family members have terrible doctor stories, one even won a huge malpractice law suit. We can’t hide the real problems because we’re afraid of anti-vaxxers.
Generally the medical system is in a bad place. Doctors are often frustrated with patients who demand more attention to their problems. You can even see it for yourself on doctor subreddits when things like Fibromyalgia is brought up. They ridicule these patients for trying to figure out why their quality of life has dropped like a rock.
I think similar to tech, Doctors are attracted to the money, not the work. The AMA(I think, possibly another org) artificially restricts the number of slots for new doctors restricting doctor supply while private equity squeezes hospitals and buys up private practices. The failure doctors sit on the side of insurance trying to prevent care from being performed and it's up to the doctor who has the time/energy to fight insurance and the hospital to figure out what's wrong.
You must not be involved in the medical field to realize how bad it is especially when it come to diagnosis.
yea specially because he is not saying what diagnosis It was, if you want to say doctors were unscientific at least be scientific and give the proper medical account of the symptoms and diagnosis
The fact is that doctors are human, so they have cognitive biases and make mistakes and sometimes miss things, just like all other humans.
Did you get the flu shot this year tho? Be honest.
> ...this is the type of reasoning which propels the anti-vax movement.
So what? Am I supposed to clutch pearls and turn off my brain at the stopword now?
> How frequent are mis-diagnosis like this?
The anecdote in question is not about mis-diagnosis, it's about a delayed diagnosis. And yeah, the inquiry sent a doctor down three paths, one of which led to a diagnosis, so let's be clear: no, the doctor didn't get it completely on their own, and: ChatGPT was, at best, 33% correct.
The biggest problem in medicine right now (that's creating a lot of the issues people have with it I'd claim) is twofold:
- Engaging with it is expensive, which raises the expectations of quality of service substantially on the part of the patients and their families
- Virtually every doctor I've ever talked to complains about the same things: insufficient time to give proper care and attention to patients, and the overbearingness of insurance companies. And these two lead into each other: so much of your doc's time is spent documenting your case. Basically every hour of patient work on their part requires a second hour of charting to document it. Imagine having to write documentation for an hour for every hour of coding you did, I bet you'd be behind a lot too. Add to it how overworked and stretched every medical profession is from nursing to doctors themselves, and you have a recipe for a really shitty experience on the part of the patients, a lot of whom, like doctors, spend an inordinate amount of time fighting with insurance companies.
> How often is "user research" helping or hurting the process of getting good health outcomes?
Depends on the quality of the research. In the case of this anecdote, I would say middling. I would also say though if the anecdotes of numerous medical professionals I've heard speak on the topic are to be believed, this is an outlier in regard to it actually being good. The majority of "patient research" that shows up is new parents upset about a vaccine schedule they don't understand, and half-baked conspiracy theories from Facebook. Often both at once.
That said, any professional, doctors included, can benefit from more information from whomever they're serving. I have a great relationship with my mechanic because by the time I take my car to him, I've already ruled out a bunch of obvious stuff, and I arrive with detailed notes on what I've done, what I've tried, what I've replaced, and most importantly: I'm honest about it. I point exactly where my knowledge on the vehicle ends, and hope he can fill in the blanks, or at least he'll know where to start poking. The problem there is the vast majority of the time, people don't approach doctors as "professionals who know more than me who can help me solve a problem," they approach them as ideological enemies and/or gatekeepers of whatever they think they need, which isn't helpful and creates conflict.
> Are there medical boards that are sending PSAs to help doctors improve common mis-diagnosis?
Doctors have shitloads of journals and reading materials that are good for them to go through, which also factors into their overworked-ness but nevertheless; yes.
> Whats the role of LLMs in all of this?
Honestly I see a lot of applications of them in the insurance side of things, unless we wanted to do something cool and like, get a decent healthcare system going.
> cautious that this is the type of reasoning which propels the anti-vax movement
I hear you but there are two fundamentally different things:
1. Distrust of / disbelief in science 2. Doctors not incentivized to spend more than a few minutes on any given patients
There are many many anecdotes related to the second, many here in this thread. I have my own as well.
I can talk to ChatGPT/whatever at any time, for any amount of time, and present in *EXHAUSTIVE* detail every single datapoint I have about my illness/problem/whatever.
If I was a billionaire I assume I could pay a super-smart, highly-experienced human doctor to accommodate the same.
But short of that, we have GPs who have no incentive to spend any time on you. That doesn't mean they're bad people. I'm sure the vast majority have absolutely the best of intentions. But it's simply infeasible, economically or otherwise, for them to give you the time necessary to actually solve your problem.
I don't know what the solution to this is. I don't know nearly enough about the insurance and health industries to imagine what kind of structure could address this. But I am guessing that this might be what is meant by "outcome-based medicine," i.e., your job isn't done until the patient actually gets the desired outcome.
Right now my GP has every incentive to say "meh" and send me home after a 3-minute visit. As a result I more or less stopped bothering making doctor appointments for certain things.
[flagged]
I get where you’re coming from. I would argue the mistakes doctors make and the amount of times they are wrong literally dwarfs the amount of anti vaxers in existence.
Also the anti vax movement isn’t completely wrong. It’s now confirmed (officially) that the covid-19 vaccine isn’t completely safe and there are risks taking it that don’t exist in say something like the flu shot. The risk is small but very real and quite deadly. Source: https://med.stanford.edu/news/all-news/2025/12/myocarditis-v... This was something many many doctors originally claimed was completely safe.
The role of LLMs is they take the human bias out of the picture. They are trained on formal medical literature and actual online anecdotal accounts of patients who will take a shit on doctors if need be (the type of criticism a doctor rarely gets in person). The generalization that comes from these two disparate sets of data is actually often superior to a doctor.
Key word is “often”. Less often (but still often in general) the generalization can be an hallucination.
Your post irked me because I almost got the sense that there’s a sort of prestige, admiration and respect given to doctors that in my opinion is unearned. Doctors in my opinion are like car mechanics and that’s the level of treatment they deserve. They aren’t universally good, a lot of them are shitty, a lot are manipulative and there’s a lot of great car mechanics I respect as well. That’s a fair outlook they deserve… but instead I see them get these levels of respect that matches mother Theresa as if they devoted their careers to saving lives and not money.
No one and I mean no one should trust the medical establishment or any doctor by default. They are like car mechanics and should be judged on a case by case basis.
You know for the parent post, how much money do you think those fucking doctors got to make a wrong diagnosis of dementia? Well over 700 for less than an hour of there time. And they don’t even have the kindness to offer the patient a refund for incompetence on their part.
How much did ChatGPT charge?
I think the ultimate answer is that people must take responsibility for their own health and that of their children and loved ones. That includes research and double-checking your doctors. True, the result is that a good number of people will be convinced they have something (eg. autism) that they don't. But the anecdotes are piled up into giant mountains at this point. A good number of people in my family have had at least one doctor that has been useless in dealing with a particular problem. It required trying to figure out what was wrong, then finding a doctor that could help before there were correct diagnoses and treatments.