alt Hacker NewsYes, point taken. I am well aware of the intelligence explosion and I am very AI pilled.
But the core problem still exists based on the clarity of the prompt and the prompter.
Seeing my wife's depth of intuition and expertise as a physician, compared to my comparatively caveman-like prompts when asking for health advice, there's a massive delta in accuracy.
Have you ever had a significant health issue and tried to get help from a model? Even something like GPT 6 Pro? The firehose and confusion you will generate trying to figure out answers are far less helpful than having directed interaction with a physician.
Following up on this because I've been thinking about why this is. I believe a big part of it is just that the intuitive parts of medicine are learned essentially by internship and therefore are not well encoded into the models. Unlike software, where you can have deterministic output that the models can train on, medical outputs are very fluid and dynamic. What works well in a paper, even though we claim to do evidence-based medicine, may be very far from what a "good" physician does in practice.
The issue is that the AI is at best what's in papers and medical records, which often forgoes the core thing that might lead a physician to uncover something or take a different approach with the patient.