logoalt Hacker News

shlantlast Friday at 1:44 PM1 replyview on HN

you think ChatGPT was purposefully and maliciously prompted to tell someone they had ADHD?

and your reasoning for this is what?


Replies

efilifelast Friday at 11:27 PM

No! Maybe I wasn't entirely clear in what I wanted to say.

The point is ChatGPT gets various info about you and it won't disclose to you that it has them.

There's the memory feature, but various reports (and my own experience) indicate that even if you disable it, some stuff you've said before (or the LLM inferred) is still fed into its sytem prompt.

We also know that AI can sometimes make up stuff. I think it might have "guessed" the user has ADHD, this got added into the system prompt and it won't be revealed to the user considering how this works. It wasn't done on purpose and wasn't malicious.