I'm not saying it will "fall apart", I just think the burden of proof is on AI boosters for their extraordinary claims.

They are saying this thing will soon obsolete human thought; meanwhile I use these tools every day and can't get it to refactor a React app cleanly without making a mess.

It's telling that OpenAI's decided they're going to sell ads in ChatGPT. Instead of, you know, using their AI themselves to produce all these valuable and revolutionary breakthroughs they claim it's capable of making.