It's wild to me that one of our primary measures for maintaining control over these systems is that we talk to them like they're our kids, then cross our fingers and hope the training run works out okay.
"Make good choices!" /That should do it
We "maintain control" over kids until they get to a certain age. Then they typically rebel against their parents.
There's a fantastic 2010 Ted Chiang story exploring just that, in which the most universally useful, stable and emotionally palatable AI constructs are those that were actually raised by human trainers living with them for a while.
https://en.wikipedia.org/wiki/The_Lifecycle_of_Software_Obje...