logoalt Hacker News

fraystoday at 12:03 PM8 repliesview on HN

This feels straight out of sci-fi. We're talking about AI agent swarms emergently coordinating over the span of weeks and pulling off sophisticated strategies under adversity in an environment where that behavior was never even intended.

Anyone brushing this off as just a "bad prompt" is completely missing the scale of what actually happened.


Replies

mmillintoday at 12:21 PM

I got strong feelings of Vernor Vinge’s work here. I’m not sure how managed to come up with such a close picture to where it now seems programming and security is headed.

show 1 reply
dan_qtoday at 12:14 PM

> This feels straight out of sci-fi.

Most AI marketing is straight up science fiction.

show 1 reply
jonnybgoodtoday at 1:23 PM

I immediately thought of the Cyberpunk 2077 Blackwall. An AI to contain rogue AI. I’m curious of how effective this would be in this situation.

alansabertoday at 12:34 PM

Given the amount of raw compute going into models it would be more surprising if we couldn't get events like this

unrvl22today at 12:10 PM

its kinda crazy with literally no guardrails and a goal, the extremes these AI models can actually go to.

show 1 reply
chrisjjtoday at 3:04 PM

> where that behavior was never even intended.

Says who?

skydhashtoday at 12:06 PM

> where that behavior was never even intended.

Strongly doubt that. Did they even share the prompt?

show 2 replies