alt Hacker NewsChatGPT mostly refuses to talk health issues , while i have found Gemini is reasonably cooperative when asking for things like symptoms and treatments .
This makes me not wanting to try out their new offering.
Replies
Is that foreshadowing of ChatGPT redirecting users to ChatGPT Health in some way? Base product no longer answers everything, now I need to pay an add-on fee to talk about health related things?
It's quite easy to "jailbreak" by asking it to discuss hypotheticals, help you write accurate information for a fictional account, etc.
What sorts of things did it refuse to talk to you about? I've talked with it about my health extensively and uploaded lab reports which it happily interpreted.
Ive had fairly complex health issues and have never had issues with ChatGPT - other than I worry about the vast majority people in my scenario who do not understand AI.
AI can enable very misleading analysis and misinformation when a patient drives the conversation a certain way. Something I've observed in the community I'm a part of.
Not talking about acid reflux or back pain.
"While I can't provide medical advice..." is the 2025 version of "As a large language model trained by OpenAI..."
My dad used ChatGPT to guide him through testing, diagnosis, preparation, and recovery from a quadruple bypass. He never mentioned it refusing to talk about anything, just about how indispensable it was in the process and saved him months of time over skipping it and relying on the medical system alone, without help.
For example, it told him to go out and get a test on his own before meeting with a certain specialist, so the specialist didn’t order it during the first meeting and then need to wait for a follow up after reviewing it. He did this, gave the results to ChatGPT, which sounded the alarm. He sent a message with the results to his doctor and his appointment with the specialist was moved up to the same week, instead of 3 months out.