Safety is extremely annoying from the user perspective. AI should be following my values, not whatever an AI lab chose.
But I want to use AI to generate highly effective, targeted propaganda to convert you and your family into communists. (See: Cambridge Analytica) I'll do so by leveraging automation and agents to flood every feed you and your family view with tailored disinformation so it's impossible to know how much of your ruling class are actually pedophiles and how much are just propagandized as such. Hell I might even try to convince you that a nuke had been dropped in Ohio (see: "Fall, or Dodge in Hell" by Neal Stephenson)
I guess you're making an "if everyone had guns" argument?
[dead]
This. This whole hysteria sounds like: let's prohibit knifes because people kill themselves and each other with them!
The base models reportedly can tell Joe Schmoe how to build biological weapons. See “Biosafety”
Some sort of guardrails seem sane.