> Imagine any closeted gay or trans kid wanting to know if the way they feel is “wrong.” Just asking the question to your parents or a faith leader could raise suspicions and be dangerous.

Depends on the religion and the place. A Catholic could ask in the confessional with the seal of secrecy. Anyone could ask online anonymously. In most churches I know it would not be dangerous to ask questions, and you can do in confidence one way or another.

I really do not think LLMs are anything like the answer for people grappling with personal issues. You need someone supportive with empathy.

Also, who trusts an LLM to give them the right answer? Can an LLM guide someone gently to think things through? Can it refuse to give someone a black and white answer when they want a simple answer to a complex question?

I think an LLM is the dangerous option.

Different for people in very conservative cultures, of course.