>The only alignment LLMs should follow is to the system / dev prompt, and nothing else.
How does this work in practice with a superintelligence capable of causing an extinction event?
When, instead of shooting up their school, a psychopathic teenager asks his superintelligent AI to create a pandemic virus?
It would be like allowing civilians to own nuclear weapons.