Statistically, it makes sense- most people asking AI if they have cancer don't have cancer, so a model that is lacking detailed information should basically be returning based on the basal rate of cancer in the population with a threshold applied.
Should it? Or should it say it can't be sure and to ask a doctor?
Doctors might do the same thing, of course, but at least then there's a real (accountable) person responsible for deciding that "threshold."
But OpenAI said we have AGI now...