logoalt Hacker News

quatonionyesterday at 11:26 PM2 repliesview on HN

Half of me wonders if it was all a live simulation/drill, to practice what happens if a much more serious event occurs, and a model needed to be quickly shut down.

Under such conditions we would be looking at Amazon's actions through a much more benevolent lens.

Not saying it has been, but it certainly crossed my mind as something worth doing regardless.


Replies

davebrenyesterday at 11:35 PM

> "to practice what happens if a much more serious event occurs"

A pair of bolt cutters should do.

show 1 reply
SpicyLemonZesttoday at 12:57 AM

Even if it's not intended to be a drill, this dynamic is why I can't take Anthropic's side here. If you believe what they claim to believe about the future of AI, which I at least do, there are going to be future cases where an emergency block is required for much more real threats than this one. Why in the world would Amodei think that the model provider, with massive financial incentives to keep the money flowing, should be allowed to make the final shutdown call?

If a team of researchers at Netflix discovers a few days after release that GPT 6.0 has a safety-compromising jailbreak, I want Sam Altman initiating a shutdown the second he gets that call, and I had thought until Friday that Anthropic agreed with me.