you mentioned a very good point about scalability. we're seeing alot of productivity gains, but only from SWEs, which are but a very small segment of the global economy. all other economic use cases require thorough last-mile development and iteration that is not too different with current automation tools.
All those automaton tools will eventually be initially one-shotted and then monitored by LLMs though. There probably won't be a "last mile" per se; just constant tweaking and optimizations throughout, within a feedback loop.
We aren't seeing productivity gains in software either. What we are seeing is a lot of people who claim to be more productive, but in fact are building piles of tech debt that will fall over before long. But hey, they're building that tech debt really fast!
A friend who is a psychologist was telling me he thinks in another year or two insurance companies will insist people see an AI therapist first before being willing to pay for a real person.