I sadly have to agree with you. I had a 30+ year orthopedic surgeon confidently tell me my ACL wasn't torn.

Two years later when I got it fixed the new surgeon said there was nothing left of the old one on the MRI so it must have been torn 1.5-2+ years ago.

On the other hand, to be fair to doctors, I had a phase of looking into supplements and learned the hard lesson that you really need to dig into the research or find a very trusted source to have any idea of what's real because I definitely thought for a bit a few were useful that were definitely not :)

And also to be fair to doctors I have family members who are the "never wrong" types and are always talking about whatever doctor of the day is wrong about what they need.

My current opinion is using LLMs for this, in regards to it informing or misinforming, is no different than most other things. For some people this will be valuable and potentially dramatically help them, and for others it might serve to send them further down roads of misinformation / conspiracies.

I guess I ultimately think this is a good thing because people capable of informing themselves will be able to do so more effectively and, sadly, the other folks are (realistically) probably a lost cause but at the very least we need to do better educating our children in critical thinking and being ok with being wrong.