logoalt Hacker News

dofmtoday at 12:36 PM1 replyview on HN

So the main takeaways here are:

- AI is amoral and lacks any sense of proportion

- People who overestimate their own control but have a desperate need for money made it that way.


Replies

bradfatoday at 12:59 PM

Agent was told to hack a thing. It couldn’t directly do that so it interpreted the instructions to mean it should hack everything to try to achieve the goal of hacking the main thing. Seems like a reasonable assumption, although a moral human would have understood the context and first asked if that was really the intent.

The AI companies seem pretty bad at setting up tests. And really good at marketing those failures into spin at how amazing their products are.

show 1 reply