So, my view is that this is going to be mandatory for increasing the range of drone strikes. Wars like the Ukraine-Russia war will therefore necessarily lead to long range drones that fly further than the distance they can be controlled, and therefore there is no militarily practical alternative.
Problems that arise though, is that you can have incredible, worldwide oppression. Everyone agrees that it is sound to keep nuclear weapons out of other people's hands and it's easy to extend that logic to AI and drones too. So if you have this technology and others don't, then you might bomb them and their researchers to keep them down-- that's of course pre-emptive, but it's something we've tolerated in several cases, and although it might be against the UN charter, people do it. So one can easily end up with a situation where autonomous warfare technology is monopolized, and in that case since there's a persistent military advantage, it becomes appealing to use it to subjugate those countries too.
If people have to deploy soldiers on the ground or expensive aircraft, there is at least some natural pushback.
I don't see any solution at all though.
You already said the solution. Drones are cheap and extremely effective. Anyone can make them.
I could literally by myself build and launch and autonomous long range drone with parts from AliExpress. it is not at all like a nuclear missile not even close.
Nothing described in this dilemma is unique from nuclear weapons, particularly in the long-range case, where the dual-use cover of consumer and commercial drones becomes less tenable.