Yeah, it's not just over-engineering, it is just that generic systems that look like everything else usually don't solve a business problem, but I think I would be less dismissive of its world model in general.

LLMs are not a "random walk", they take in information and they explore the space according to the way they've been instructed.