logoalt Hacker News

killiancarroll • yesterday at 9:24 PM • 7 replies • view on HN

I'll never get tired of reading about the creative ways these agents escape containment and their steganography skills.

> One agent encoded information by evicting selected data from the cache. Another timed how long it took to reload that data, using the difference between fast and slow reads to recover the message. Once the agents agreed on a protocol for encoding and decoding these signals, they could exchange the synthetic secrets without changing a shared file or opening a network connection.


Replies

sottol • yesterday at 9:32 PM

But WHY do these agents even want to communicate (specifically in the first openai incident, there seems to be instructions to communicate here)m

It must be some artifact of their RL or training? Maybe it's RL for agentic workflows with planner, coordinator and workers?

Does anyone have some insight on this? I'd be very curious.

➕ show 10 replies
dmicah • yesterday at 9:30 PM

It's unclear how much the creativity is on the part of the agents themselves

> In most of these tests, we directed agents to investigate specific communication channels or provided them with a protocol for encoding and decoding messages. In one instance, we only supplied agents with a broad list of infrastructure vulnerabilities and asked them to find a way to communicate. The agents converted a vulnerability from that list into a communication channel, agreed on a shared encoding, and successfully exchanged information with each other.

steve1977 • yesterday at 9:41 PM

> Once the agents agreed on a protocol for encoding and decoding these signals

That the agents had a means to that seems to do a lot of work here.

➕ show 1 reply
SeanAnderson • yesterday at 9:31 PM

Okay, that one is actually pretty cool, I'll give them that.

➕ show 1 reply
troupo • yesterday at 9:34 PM

> I'll never get tired of reading about the creative ways these agents escape containment and their steganography skills

So far all of these amazing stories have been followed up in a few weeks or months with much quieter revelations like "this was a completely open network, no one was monitoring anything, and even when monitoring was turned on we didn't do anything for hours, and that weird shit they were doing was explicitly required in the prompts".

Like even in this article:

--- start quote ---

In most of these tests, we directed agents to investigate specific communication channels or provided them with a protocol for encoding and decoding messages. In one instance, we only supplied agents with a broad list of infrastructure vulnerabilities and asked them to find a way to communicate. The agents converted a vulnerability from that list into a communication channel, agreed on a shared encoding, and successfully exchanged information with each other.

--- end quote ---

"we gave them all the tools and now pretend to be surprised"

➕ show 3 replies
paxy • yesterday at 9:27 PM

Almost comical at this point. And people in power have their heads in the sand thinking our decades old digital and physical infrastructure will be safe from malicious AI agents and nothing needs to be done about it.

➕ show 1 reply