> These models do have the cyber offensive capabilities claimed.
People use this argument against every new technology. We need to license these new printing presses or subversive elements will use them to publish seditious literature. We need to ban strong encryption or the government won't have invisible warrantless access to everyone's private messages, think of the children. 3D printers can be used to make gun parts -- as can a variety of ordinary tools people commonly have at home, but never mind that bit.
> The sad truth is that a lot of people are not going to believe it until something happens and people die. Successfully preventing that from happening will be seen as evidence that the prevention wasn’t needed.
A 12 oz bottle of water is too dangerous a technology for ordinary people to have on an airplane. Four 3 oz bottles and an empty 12 oz bottle to pour them into after passing through security is totally fine though, naturally. And we need to keep this up forever, or don't you remember 9/11?
The issue here is not that it's impossible for 12 oz of unknown liquid to damage an airplane.
I am inclined to agree. The issue is that we are humans and not all of us play nice. And sometimes, even when we play nice, things happen. I am not big on guardrails, because in US they have turned into yet another cottage industry and I fully expect an association credentials popping on linkedin soon. What this means in practice is that it is never enough. Whatever the current state is, the association will be pushing towards yet another another extreme.
There is an argument to be made that there are a lot of not great people out there, who may abuse tech, but the response should be not be: kneecap said tech. The response should be: smack those people's hands. I don't think anyone will actually complain if police catches someone, who is looking up poison recipes.
What I do think, however, that reasonable people will complain when we move to the pre-crime territory ( you saw him looking up poison recipes and did nothing! ) and show up at your door to inquire about your llm prompts. To me it is an issue.