alt Hacker NewsIt "makes sense" that plainly telling the chat bot to make one button blue makes the whole site blue? It "makes sense" that correcting it and repeating 3 times that no, only the one button should be blue, should make the button a gradient and start a philosophical discussion around the nature of "blue"?
Wow, you AI people really have a negative view of the technology y'all are trying to sell as the next Jesus
Replies
kstenerud • today at 6:01 PM
If the agent's change has such a catastrophic effect, the first thing you do is tell it to explain why its change had that effect.
Once you understand what the problem is, you can give it better instructions. If the architecture is shit, the agent is going to have a rough time of it.
I'm not trying to sell the technology at all, much less as a messiah, and I absolutely have a negative view of it. It's a token predictor - nothing more, nothing less. If you treat it like it is supposed to "make sense" of things, you get predictably bad results. It "makes sense" that if you don't make the sense for it, it will do poorly, because it's a glorified auto-complete.