I mean.. There are degrees of control and agency right? I really don't understand the impetus to pretend AI is just doing exactly what its told.
a human decided that control and agency surface, then clicked go
a human is always behind it and ultimately responsible
To avoid sarcasm, isn't the term "artificial intelligence" part of the answer to your puzzlement? If people object to "stochastic parrot", and want some more precisely descriptive term like "artificial intelligence", then why do we experience surprise when people act as if that system is intelligent?
There is a lack of due diligence and effort to restrict and properly configure AI to operate within the bounds of the law.