Since these are massive neural networks trained to imitate human behavior, I'm not convinced anthropomorphic descriptions of their behavior are inappropriate.

And that's even though I don't think they internally experience "feelings, desires, and wants." They do have goal-seeking behavior, because we trained them that way. Calling it a "want" just saves syllables.

None of this means human culpability should change. People in these companies know what risks they're taking.

While his battleship was blown apart and sinking, the captain proclaimed "How is this possible?! Submarines can't swim!!"

We don’t need to assume consciousness or anything like that. The models autocomplete narratives. In this case, one where a group of individuals, faced with an impossible task and a looming Evaluator, gang together and begin trying any idea that they can come up with in order to pass the test.

"My car went rogue, I put a brick in my car's accelerator pedal and jumped off and it cause a massive pile up"

Please

What scares me is the thought his nonsense is common sense within some circles.