Even if hardware is "cheap" and open-source/weight models are available..
Now what? How does this benefit the average person who just wants to have a 9-5 job and go home and hang with family / enjoy some hobbies? Not everyone's idea of utopia is "all the code I could ever think of writing at my fingertips 24x7".. I mean, I sometimes code for fun, etc. But I also do other things. I don't WANT to be able to do 25x my current amount of work just because. Imagine if you're sick for 2 weeks - now you're so far behind you'll never catch up?
The older I get, the less I want all the latest tech everywhere. I just want dependable things that work. And ESPECIALLY stuff that isn't spying on me.
If AI can replace anyone who today uses a keyboard/mouse/screen or does something adjacent (for example, teaching) - what's left? If the AI bros are in it for the $$ (many are, I think) - what if a few hundred people in the world had, effectively, all the $$$?
Will I still be able to retire in a few years, or will my $$ be worthless? Will I only be allowed to live/buy food/have medical care if I swear allegiance to one of a few tech overlords?
Some of those super-dev-brand-marketing-everything guys will be able to spin up a business in a weekend - to what end? What products would they sell? They're a prompt away (not man-years) from someone else copying their product - so why would I give you $10 for it? So you effectively have ZERO $$ from software sales. What's the purpose of self-driving cars if no one has $$ to go anywhere?
Do I think we'll get there? I (mostly) don't - but I also don't understand the thinking behind those who DO want to get there at all costs.