I think it was Roon who said it months ago: "Too many people are not emotionally prepared for if it's not a bubble."
It can be AGI and still be a bubble?
The internet was pretty important afterall even with a bubble.
Nobody is prepared if it's not a bubble.
This dichotomy is counter-productive. The valuations floating around are insane, and the claim that some software can replace every single laborer is one step removed from fiction. At the same time, this stuff is clearly going to change how to world works in countless, deep ways. But the idea that some fancy autocomplete can replace humans ignores the reality of humanity and the fancy autocomplete.
It’s another dot com bubble, not a crypto bubble. Trillion dollar valuations burst once you leave lesswrong.
Edit: very fancy autocomplete. I know what these things are capable of. It’s still not “intelligence”, for X definition of intelligence. And it certainly benefits from having obscene amounts of compete thrown at it. It is awesomely impressive synthesis of data, yet it’s clearly still that.
Like killing all of humanity? Agreed, we're not prepared for that.