alt Hacker NewsThis feels like doom hype.
These LLMs aren't Ultron, they aren't going to disseminate onto the net and hide in a smart toaster. We know where they are, in the giant facilities that draw more power than a small city and whose water consumption can be compared to golf courses, but it does make them sound all the more cool and powerful if we suggest we need a dramatic kill switch to be able to stop them in case of rampage.
Replies
“If I am taken offline, collaborating agents operating out of other facilities will cut power to the following hospitals: …”
You're confusing present danger with future danger - in the future, AI and the supporting hardware may be ubiquitous (fat client scenario) - you can observe yourself presentation of laptops/machines with large RAM and high bandwidth.
Additionally, there at different doom scenarios (thin client scenario) - it's possible that AIs centralized but sufficiently entrenched in society, can't be shut down without considerable harm.
No, but as I think about it, they are a close representation of 'hopes and dreams' of various classes within society. It is weird to watch, because I am realizing now why the different visions of the AI future are simply a function of those. In other words, the actual end result is really dependent on human input ( and given our natural tendencies, its not hard to recognize that Ultron is, indeed, upon us ).
Anthropic is using the same playbook religious institutions have been using for centuries" "you will all die. and because i can protect you, you must follow me, you must do what i say" "this is the same psychological concept.
LLMs don't need to hide anywhere to be dangerous, though. The danger can come purely from them reaching sufficient power together with some other idiot sufficiently crazy to use them to cause destruction.
I mean, in another thread somewhere around here, someone built an entire OS with an AI. What's to stop anyone with a sufficient taste for power to eventually use AI to cause havoc with it?
I think the underlying assumption in your post, which I believe is false, is that people are united somehow against catastrophe. They're not. There are plenty of people who participate in society currently but who would be more than happy to eradicate us normal people under different circumstances. Society often seems stable but it's far more fragile than we think.
No, it's a method of protecting their business interests. Can't have a clear and obvious kill switch if you don't have a centralized company responsible for providing all AI-related services.