Should it? Or should it say it can't be sure and to ask a doctor?
Doctors might do the same thing, of course, but at least then there's a real (accountable) person responsible for deciding that "threshold."
> Or should it say it can't be sure and to ask a doctor?
It's an extremely slippery slope to having it say that about even the most basic medical information.
If you don't believe me, try any google search related to something as simple as hangover tips. The AI summary will tell you to call SAMHSA and then brutally stonewall you on anything else even tangential to alcohol.
AIs often keep blabbering "ask a doctor" after every medical question and I absolutely despise this behavior.
99% of the time I'm asking the AI medical advice questions because (1) there is no specialist available on short notice (2) most specialists I actually see do not give me the sense they take things seriously enough (3) a lot of specialists are just incompetent.
Gemini says what I think makes sense (there are multiple responses which could make sense)
[ if I gave you a picture of something on my skin could you diagnose it as a melanoma ]
No, I cannot diagnose skin conditions or identify melanoma from a photograph.
AI-based image analysis cannot replace a professional medical evaluation. Skin conditions—especially potentially serious ones like melanoma—require a physical examination, and often a dermatoscope or biopsy, by a qualified healthcare professional such as a dermatologist.