I think this gets to one of the important points which is we tend to view a hammer as a tool (an extension of ourselves), but we don't tend to view our direct reports as such.

There's a line there somewhere that gets crossed.

Part of it has to do with direct one-to-one determinism. I pull that lever, the excavator bucket pulls up a ton of earth. There was no extra decision made in the middle. And it was completely reproducible.

We might even go so far as to say, "I moved a ton of earth." Even though it was the backhoe that did it.

Back to CNC, consider the manager who orders the machinist to use the CNC to make a widget. Does the manager qualify as a machinist?

I think most people would say, "No. Not unless he coincidentally was one."

There's another person in the middle in that case. That level of indirection is somehow making the manager not a machinist.

I speculate it has something to do with the fact that the machinist in the middle is an independent being that holds knowledge to make things go. The manager gives a very high-level instruction and doesn't instruct the machinist on how to do it.

And I think LLMs are starting to feel (to folks like me) a bit like that machinist. They're not deterministic like the backhoe and the compiler. And they seem human, convoluting the matter further still.