alt Hacker News> There isnt going to be a HAL or Terminator style situation ...
I don't believe for a second we'll have an evil AI. However I do believe it's very likely we may rely on AI slop so much that we'll have countless outages with "nobody knowing how to turn the mediocrity off".
The risk ain't "super-intelligent evil AI": the risk is idiots putting even more idiotic things in charge.
And I'm no luddite: I use models daily.
Replies
esafak • today at 4:19 AM
Didn't you read the news about the 'claw that blackmailed an open source maintainer last week? It was autonomous, but it could be turned off. How hard is it to extrapolate from that to an agent that worms its way out of its sandbox?
➕ show 1 reply
> I don't believe for a second we'll have an evil AI.
Doesn’t have to be evil to be disastrous. Misaligned is plenty enough.
https://en.wikipedia.org/wiki/Instrumental_convergence