GPs don't have time to do the investigation, but they also have biases.

My own story is one of bias. I spent much of the last 3 years with sinus infections (the part I wasn't on antibiotics). I went to a couple ENTs and one observed allergic reaction in my sinuses, did a small allergy panel, but that came back negative. He ultimately wanted to put me on a CPAP and nebulizer treatments. I fed all the data I got into ChatGPT deep research and it came back with an NIH study that said 25% of people in a study had localized allergic reactions that would show up one place, but not show up elsewhere on the body in an allergy test. I asked my ENT about it and he said "That's not how allergies work."

I decided to just try second generation allergy tablets to see if they helped, since that was an easy experiment. It's been over 6 months since I've had a sinus infection, where before this I couldn't go 6 weeks after antibiotics without a reoccurrence.

> The study, from UVA Health’s Andrew S. Parsons, MD, MPH and colleagues, enlisted 50 physicians in family medicine, internal medicine and emergency medicine to put Chat GPT Plus to the test. Half were randomly assigned to use Chat GPT Plus to diagnose complex cases, while the other half relied on conventional methods such as medical reference sites

This is not ChatGPT outperforming doctors. It is doctors using ChatGPT.

For every one "ChatGPT accurately diagnosed my weird disease" anecdote, how many cases of "ChatGPT hallucinated obvious bullshit we ignored" are there? 100? 10,000? We'll never know, because nobody goes online to write about the failure cases.

This is a doctor feeding the LLM a case scenario, which means the hard part of identifying relevant signal from the extremely noisy and highly subjective human patient is already done.

The problem doctors have is that 99/100 times ABC is caused by xyz, so they prescribe 123 and the problem goes away.

Overtime, as a human, the doctors just turn into ABC -> 123 machines.