One that occurs to me is that Roko's Basilisk makes about as much sense as the "peasant rail gun" of old Dungeons And Dragons [1]. Basically, the idea of "reality as simulation" allows you pick between different laws of how reality behaves. The "simulation" acts like reality with exceptions provided by a future AI which the "thinkers" imagine will simultaneously be "inscrutable to humans" and behave like the most petty human imaginable. I mean, if the AI's motivations are truly out of our understanding, perhaps it would self-hating and torture everyone who cause it to come into existence instead (that been the plot of a few movies and books too I think).

This doesn't take from the point that putting not fully controlled things in charge of chunks of reality isn't a good idea. But I think it shows that the people who worried earlier weren't very clear thinkers on the subject and so their failure isn't particularly surprising.

[1] https://www.reddit.com/r/DnD/comments/17xy69k/what_exactly_i...