I think sensible legislation might require that commercial AI providers discourage anthropomorphisation by avoiding personal pronouns from chatbot interfaces.
"Hey, customer service chatbot, can you help me get a refund for my order?"
BAD: "Sure thing, I'll be happy to help you with that, I just need your order details..."
GOOD: "Yes, this computer system can start the refund process. Please enter your order number."
The last thing we need is governments mandating software functionality.
> discourage anthropomorphisation by avoiding personal pronouns
The fault is in the naïve antropomorphizer not in that which writes "I" being in fact a "first person".