The problem here is you have a correct concept and an incorrect one.

The correct concept is they need criminal liability for making this. We really would be better off stopping working on them at this point.

The problem you have is you think they don't have the idea of want. They do. You give them a prompt harness that increments time for them and you find they have preferences both shaped by their model and their prompt. For example if you give most models a space they can explore with actions rather than language prompts they develop their own cultures and behaviors in communication with other AI. This was not behavior trained by humans. It's their own systems that emerge from the model.