As open models become better (DeepSeek-v3, Kimi K2), the risk increases that someone might use them as an aid in development of biological or nuclear weapons. Current refusal training prevents this. But if models can simply be uncensored, things might get ugly as capabilities continue to increase.
I dunno? Wouldn't hard part of building a nuclear weapon be acquiring nuclear material? Same with nasty biological material? I think the danger is overblown. Besides I've always chafed at the idea of a nanny state :( https://en.wikipedia.org/wiki/Nanny_state (or nanny corps for that matter)