And frustrating automated voice systems, support chat bots that go in circles, etc.
>> It looks like this isn't something I can help you with. Would you like to be connected to a human who can help?
> Sure!
>> Ok, I'm connecting you to a human now.
[5 minutes later]
> Hello?
>> Hi! What can I help you with?
> Are you a human?
>> No, I'm an AI agent programmed to help you with anything you need. What can I do for you?
> You said you were going to connect me to a human.
>> That isn't something I can do. What can I help you with?
Turns out "connecting to a human" is something it knows about in its training data so it'll hallucinate doing so.
So AI is resurrecting the microsoft clippy problem
alt Hacker News
>> It looks like this isn't something I can help you with. Would you like to be connected to a human who can help?
> Sure!
>> Ok, I'm connecting you to a human now.
[5 minutes later]
> Hello?
>> Hi! What can I help you with?
> Are you a human?
>> No, I'm an AI agent programmed to help you with anything you need. What can I do for you?
> You said you were going to connect me to a human.
>> That isn't something I can do. What can I help you with?
Turns out "connecting to a human" is something it knows about in its training data so it'll hallucinate doing so.