>Kind of taking this a step further, what is the worst thing that an AI run amok could do to existentially threaten the human race?
Probably convincing humans that untrue things are true. Think less "AI launches nukes" and more "AI convinces people in country A that country B is trying to subvert & destroy them, while it does the same for country B wrt A."