Yeah, that's how my fears start. I don't want to find out what happens to the global stage if one country develops autonomous killer drone swarms or something.
The militaries might be salivating at the opportunity, but I hope that the risk of rogue AIs brings us all to the same side on pausing development of bigger AI models.