alt Hacker NewsThis has been a core belief of the EA/LessWrong/Rationalist people for many years - that above a certain level of intelligence you effectively get hypnotic powers, and people will obey AIs no matter what. So they said you can't keep a superpowered AI airgapped as merely offering a chat interface will immediately take control of the next person to interact with it and they will deliberately compromise the airgapping.
Replies
zone411 • today at 4:16 PM
A complete mischaracterization, as usual for HN lately when discussing AI or LessWrong. Obviously, even average levels of persuasion are enough to convince some people. And nobody is air-gapping AI.
➕ show 1 reply
meindnoch • today at 4:32 PM
Well, we knew since the "Roko's Basilisk" debacle that they're prone to magical thinking.
And if AI wrote a book about these hypnotic powers, then it would be incredibly convoluted, long, and yet worn as a badge of pride to have survived it.
Thinking about it, much of the output I'm seeing nowadays looks like a chapter out of infinite jest.
Maybe that's unfair on infinite jest.