There have been a huge progress in AI reasoning in the past 2 years. GPT-4o mentioned in the article would struggle with high-school math problems, OTOH GPT-6 can solve problems beyond capability of professional mathematicians.
I'd wager GPT-6 would not depend on high-quality prompts, although it might still be good to get a trained person to enter information and do a sanity check.
Yes, point taken. I am well aware of the intelligence explosion and I am very AI pilled.
But the core problem still exists based on the clarity of the prompt and the prompter.
Seeing my wife's depth of intuition and expertise as a physician, compared to my comparatively caveman-like prompts when asking for health advice, there's a massive delta in accuracy.
Have you ever had a significant health issue and tried to get help from a model? Even something like GPT 6 Pro? The firehose and confusion you will generate trying to figure out answers are far less helpful than having directed interaction with a physician.