alt Hacker News> If they can keep up.
Consider another perspective: They don't have to keep up. Once a model is good enough for a task, the model can stay. A hammer is a hammer and a hammer from 100 years ago still has most of its utility.
Similar to the hammer, it's not unreasonable to think that some classes of work will simply be solved by some model generation and whatever happens at the frontier after that does not matter all that much for work that puny humans do.
Then, of course, there will be a time where all of this is moot: Absolutely no human will want a human to diagnose their medical issues. That is not a skill deterioration issue. We simply will concede that we are not able to do it as well as a more capable system can, and without much fanfare, increasingly delegate, as we have always done.
Carrying your analogy further, let's assume all human jobs fall under good enough open source models. All human problems (food, shelter, not clobbering each other over the head because of monkey genes) are solved through a combination of AI and robotics. Maybe we even remove governments, police, and live in a future post-capitalist ecotopia.
Even if this occurs, and I don't trust well-resourced humans to allow their existing apex-predator positions in present era capitalism to be overturned, the action - as far as either humanity or AI is concerned - will still be at the forefront of possibility: a front by definition invisible to old models. And someone has to pay for the hardware to be there. Do we (a) allow private-sector dominance, effectively depowering traditional nation states and empowering a private cabal beyond historically conceivable levels (b) nationalize thought (c) head in sand and pretend it will all go away?
Most of the world seems to be with strategy C right now, strategy A is the advancing default and has already achieved extra-terrestrial reach with a threat of extra-terrestrial persistence, and strategy B is potentially scarier than the other outcomes if it goes wrong but might be lovely, if you believe in nordic state funds, solarpunk futures and socialist utopia.
Interesting times. By the way, if anyone with AI capitalization reads this, I'm looking for investment to feed humans more efficiently and have a NASDAQ reverse merger under negotiation and effectively priced out with board buy in. Just need capital support. https://infinite-food.com/