alt Hacker NewsThere's two main schools of thought regarding the downsides of AI: One is apocalyptic, focusing on existential threats of the kind seen in scifi literature, and is largely influenced by the exact warnings given therein. The other, which I'll call "socio-realism", often looks into the actual past at the introduction of automation and its displacing effects.
The "AI safety" movement is largely an answer to only one side: the apocalyptic one. Doomers like Yudkowsky and his ilk are popular over there. Note how his most recent book reads like scifi, including with its implausible "solutions"? These people are living in a fantasy land. This isn't to say p(doom) = 0, but we've lived with it being non-zero since the introduction of nuclear weapons. Very little has changed there, I'd say.
For the socio-realism side, well, this model aligns well with exactly the kinds of real-world misery often posted on this site, as intellectual workers' livelihoods and telos are negated by automation. Sellers of "AI safety" don't care about them. There's no calls from that community to carve out space for us to retain a life of meaning within society when our ability to contribute is nullified. The fantasy of AI safety doesn't have room for that: they're too busy warding off imaginary demons; hence the cult-like behavior.
> There's two main schools of thought regarding the downsides of AI: One is apocalyptic, focusing on existential threats of the kind seen in scifi literature, and is largely influenced by the exact warnings given therein. The other, which I'll call "socio-realism", often looks into the actual past at the introduction of automation and its displacing effects.
Yes! Also the "apocalyptic, focusing on existential threats of the kind seen in scifi literature" serves as a useful strawman fo AI advocates to deflect attention away from the socio-realism critique.
It's happened a few times where I say I don't really care about in the apocalyptic sci-fi scenarios [1] but I'm more concern about the "socio-realism," but some AI proponent keeps trying to bend the discussion back to the unrealism of self-replicating von Neumann machines or something.
[1] The most interesting thing about the apocalyptic sci-fi scenarios is that they show the fundamental irresponsibility and recklessness of many very important AI leaders. Those people often seriously entertain those doomsday scenarios while simultaneously racing as fast as they possibly can to build the technologies that they say would enable them.