logoalt Hacker News

reducesuffering • today at 6:20 PM • 2 replies • view on HN

That the agent swarm recursively improves powerful enough and the extinction of all humans is a side effect of that goal.


Replies

iamnothere • today at 6:23 PM

If that’s the reality, you would think that employees would be willing to break an NDA for it. “We’re all going to die, but I really need my bonus this year” seems like a parody rather than a real strongly held position.

If anything this points to a more moderate (but still bad) worry among the employees.

➕ show 4 replies
dachworker • today at 6:26 PM

That's sci-fi. They cannot "recursively improve". There is no magic to LLMs. An agent swarm can increase it's thinking power by increasing the number of agents, the thinking time and by changing the base model to a more powerful one. So at worst they can assign themselves more compute or hijack another agent swarm based on a more powerful model.

➕ show 4 replies