"The useful distinction is between wielding an instrument with skill and delegating work without adequate understanding or oversight."

-----------------

Incidents like the HuggingFace hack really are the elephant in the room here. The people building these tools couldn't wield them "with skill", in the sense that the tools they built and understood better than any other humans alive ran amok in ways they couldn't predict. If they didn't have adequate understanding of what they themselves built, who would?

Agency may prove to be the difference between a tool and a collaborator. Calling AI a collaborator isn't an attempt to anthropomorphize it. We can collaborate with a horse to travel, but the horse has some agency of its own and might escape our control and do things we didn't intend, like eat apples off of a stranger's tree. We may need to think of AI as something more than a mere tool if we're going to harness it to our will.