Yeah, I'm fascinated by AGI, but not very enthusiastic about it. I've yet to see anyone, notably not even the people trying to build it, articulate a future where it seems to be a net positive for society.

If it's a choice between everyone living on food stamps or reducing the infinite prime gap to 140, then I guess I'll be happy with a prime gap of whatever it was yesterday.

If/when we do eventually build a more animal-like true human level AGI - build a brain, not just a language model, then potentially we'd be able to build in some of the safeguards that millions of years of co-evolution have built into ourselves, but I expect that is still decades away, and then it'd be capable of doing even more jobs!

The best AI outcome I could wish for is where it is extremely heavily regulated, and AI replacing any human job paying under $1M/yr is banned.