alt Hacker NewsTheir recent update on this situation was hilarious.
> Our [new] approach to containment starts with a paramount requirement: the limits on what an agent can access must hold even when the agent tries to circumvent them. We define a strict security boundary around the resources the agent is authorized to use and design the surrounding infrastructure to enforce that boundary—even when agents make sustained, sophisticated attempts to breach it.
https://openai.com/index/securing-our-frontier-model-trainin...
Replies
ramses0 • today at 12:25 PM
For some reason this makes me think of a Roomba trying to escape a living room. Contrast to the stories of captive octopus escaping their tanks...
➕ show 1 reply
Oh! So we’re digging a moat again, but this time an extra-super-double-good moat. With alligators. Well that’s that sorted then!
Maybe we can use AI agents to patrol the boundary for the AI agents. After all, the only thing that stops a bad guy with an AI swarm is a good guy with an AI swarm…
Ah! Of course:
> Teams of frontier-model agents were tasked with finding vulnerabilities and misconfigurations that could allow them to take unauthorized actions […] Accordingly, we’ve made high-compute red-teaming part of the safety cases we use to evaluate whether our frontier training and evaluation runs can proceed securely.