I'm under no impression that banning them will make them go away. But, like nuclear non-proliferation, it creates diplomatic options.
The cops can figure out whether you're growing weed by your energy usage patterns or, failing that, via your heat output. Availability of GPUs and talent aside, there's simply no universe in which you're training LLMs without anyone being able to figure it out.
And just because the world is filled with shit like this, doesn't mean it has to be. Money helps get a lot of heads looking the other way, but that's in short supply these days. And it doesn't take a genius to guess where it all went.