alt Hacker News+1 it’s a tool
It’s not perfect, it has shortcomings, it sometimes produces bogus outputs. All of that is fine for a tool, it’s not fine when it pretends it’s a conscious being, because errors start to feel like lies and it becomes a bit too personal.
People want it to be Data from Star Trek, when it really should be the ship's computer. I want to tell it to run a simulation accurately, create some solved tool, etc.
I don't think there's any correction that can return LLMs to a purely tool-space. Too many AI boyfriend/girlfriends.