But it's not correct! Exactly because it can't possibly have enough training data to fill the void of not being able to experience the human condition. Text is not enough. The error rate of LLMs are horrendously bad. And the errors grow exponentially the more steps follow each other.

All the great work you see on the internet AI has supposedly done was only achieved by a human doing lots of trial and error and curating everything the agentic LLM did. And it's all cherry picked successes.