alt Hacker NewsThe issue is LLMs are, by design, non-deterministic.
That means that, with the current technology, there can never be a deterministic agent.
Now obviously, humans aren't deterministic either, but the error bars are a lot closer together than they are with LLMs these days.
An easy to point at example is the coding agent that removed someones home directory that was circulating around. I'm not saying a human has never done that, but it's far less likely because it's so far out of the realm of normal operations.
So as of today, we need humans in the loop. And this is understood by the people making these products. That's why they have all these permissions and prompts for you to accept/run commands and all of that.
Replies
The viral post going around? The one where the author's own root cause analysis says "Human Error"[0]?
What's the base rate of humans rm -rf'ing their own work?
[0] https://blog.toolprint.ai/p/i-asked-claude-to-wipe-my-laptop
There's lots of _marketing_ promising unsupervised agents. It's important to remember not to drink the cool-aid.
> An easy to point at example is the coding agent that removed someones home directory that was circulating around. I'm not saying a human has never done that, but it's far less likely because it's so far out of the realm of normal operations.
And it would be far less likely that the human deleted someone else's home directory, and even if he did, there would be someone to be angry about.