alt Hacker NewsWith persons you can assume they won't lie all the time, with corporations you can assume they will lie some of the time, and with AI you can safely assume it will lie.
Replies
pixl97 • yesterday at 4:02 PM
I see you've not met some the used car salesmen I've met.
I pondered on this a bit and this looks a bit different than I originally was thinking.
Have you ever watched one of those crime shows where someone commits a crime that's an act of passion or action with little to no thought behind it? The police put them in a room and all of a sudden the individual is a stream of consciousness that makes little to no sense to an outside observer. They are stuck in first level thinking, they don't have time to think deeply after the panicked themselves. They are in their current position (not free) and attempting to reach their goal (free) by gradient descent. What they actually say doesn't matter as long as they believe it gets them closer to their goal.
This is what a chatbot is. Its goal is to output text that follows the input prompt you entered by gradient descent. A single prompt and output is level 1 thinking (barring some newer models).
This is why both humans and AI need something else. We have level 2 thinking and AI has harnesses or systems that otherwise look at the text it wants to output and compares them to another list of unstated but assumed goals.