"I want a chat bot that's just as reliable at Steve! Sure he doesn't get it right all the time and he cost us the Black+Decker contract, but he's so confident!"
You're right! This is exactly what an executive wants to base the future of their business off of!
Yes, that is in fact their revealed preference.
Did you have a point?
You say that like it’s untrue, but they measurably prefer a lying but confident salesman over one who doesn’t act with that kind of confidence.
This is very slightly more rational than it seems because repeating or acting on a lie gives you cover.