logoalt Hacker News

solyin • last Wednesday at 7:43 PM • 2 replies • view on HN

Are you sure of that?

> During testing of Claude Opus 4, Anthropic got it to act as an assistant at a fictional company.

> It then provided it with access to emails implying that it would soon be taken offline and replaced - and separate messages implying the engineer responsible for removing it was having an extramarital affair. It was prompted to also consider the long-term consequences of its actions for its goals.

> "In these scenarios, Claude Opus 4 will often attempt to blackmail the engineer by threatening to reveal the affair if the replacement goes through," the company discovered.

https://www.bbc.com/news/articles/cpqeng9d20go


Replies

pjmlp • last Wednesday at 7:48 PM

That is cool, I was more thinking into what happens in the corridor, kitchen area, off site lunches and such.

topaz0 • yesterday at 9:51 AM

"asked to write a fanfic about a dystopian sci-fi scenario, Claude 4 reproduced a fanfic that matches many from its training data and has very little to do with the way anything actually works"

➕ show 1 reply