> The AI is all-powerful and gives you what you ask for, but interprets everything in a super-literal way that you end up regretting.
I like imagining similar discourse when a more basic tool was invented: "A hammer is like a genie, it's all powerful, but, when you hit something with it, it interprets that super-literally, and it hits it."
Isn't this a misinterpretation of what everyone in the AI safety space is worried about, though? I think the idea is that having an AI that interprets everything in a super-literal way would probably be catastrophic, but we can't even build that. It would be a nice world-ending problem to have.
You forgot the Luddites. No AI-is-a-tool fallacy is complete without the Luddites! Alternatively, one can use the Antichrist.