Imagine a car, that does nothing until a person controls it. If a person uses that car to kill, who is responsible, the person or the car?
Is it really so unbelievable that tools, objects and inanimate things don't have agency? And that they different from a person?
Legally speaking, we hold the person responsible in that scenario.
From a predictive perspective, the HuggingFace incident illustrates LLM agents behaving in very human-like ways. As roon put it:
"if you have a mental picture of guys living in computers, it’ll likely prepare you for the future better than otherwise"
Imagine you have a self-driving car and it's in a parking lot a mile down the road. You tell it to come pick you up. About half way to you the car is passing an elementary school makes a sharp left and mows down 30 children. Time to put you in jail for murder, right?
The mental model you have is one that existed in the past and is broken now the future arrived. Bad analogies do not even begin to explain what is occurring.