This could also be the perfect argument of why ASI is just around the corner: One breakthrough in architecture and we already have so much more training data then it ever need again.
If we can make smart humans with a lot less, why do we even need that much for an LLM?
Perhaps world models will bring ASI, perhaps when LLM progress slows down, labs start to explore a lot more architectures and suddenly find it or the next Mythos will design the ASI architecture.