Yes, exactly, it's 'us' not the AI, which is great.
Why on earth would we ever remotely compare a 'tool' to 'a software engineer' ?
The 'great delusion' is not that 'AI can't code' - because obviously it can, and very well.
The problem is the 'anthropomorphism' and all this AGI nonsense.
If we called it 'Stochastic Mechanisms' and did not 'personalize' our prompts, refer to them as 'chat' or give them 'personalities' but remained in the domain of 'Stochastic Language CLI' ... then our metaphors would pbably not cloud our judgments.
Let the philosophers argue about AGI.
Because the alternative would've been telling everyone "here's the Stochastic Machine. The more what you write looks like the sources we blatantly stol- I mean, trained from, the closer it gets to output working code". And we're not ready to admit we don't want to know how the sausage is made.
By anthropomorphizing it, we give it some sort of authorship, which clears our collective conscience from what's really happening.
The saner philosophers don’t need to argue about AGI because we’re absolutely nowhere near it.
You are a tool. You're a human resource, from the perspective of the organization. That pushes buttons on bunch of other tools. That's why you compare it.
Edit: I don't mean tool as a perjoritive.