It's the wrong way around. If we get AGI (or any well working AI) before we abandon capitalism it's going to be a huge disaster. A handful of even richer even more powerful very greedy people will have all the wealth and everyone else will have nothing. I mean, there was a WW3 in Star Trek, so maybe it was that path that humanity took in Star Trek anyway?
If AI takes over to slowly, we might play the boiling game aka we don't realize that the water gets warmer and warmer until we boil.
But lets be honest, i don't know that, you don't either. But if a critical mass is reached, faster, we might need to actually solve this problem instead of migrating to a very dystopian future.
Stoping is not an option i think. Anthropic vs. OpenAI vs. Google <<< they ahve so much money and so much to loose. And then we have USA vs. China.
> so maybe it was that path that humanity took in Star Trek anyway?
It was (aside from first contact, and the subsequent development of the replicator which enabled the post scarcity economy). The federation was built from the war, not after it.
Suffering is what made the utopia possible, and if ever get to the point of nearing a post scarcity economy, we are likely to experience the same. Progress is built on catastrophe. Whether or not you call it progress depends on if you are born later after the catastrophe and can look back and call it progress, or if you lived through the suffering without seeing the end result.