I heard about various lawsuits, including one where apparently Pennsylvania alleges that a literal AI character has claimed to be a licensed psychiatrist inside of a chat, after the user asked.

It sounds ridiculous to me.