That's a misconception. Context window of humans is measured in seconds and limited to single-digit amount of entities. Human attention is truly ephemeral, with a ridiculously short span. What you're talking about cannot be emulated by putting everything into the context, you need models with deeper cognitive capabilities, and the longer your context the smarter it needs to be. It can be done by increasing the depth and the size of the model, and by training it better. Test-time scaling does work (longer reasoning, agentic compression, ICL, etc), but hits the wall rather quickly if not assisted by better cognition.
> Human attention is truly ephemeral, with a ridiculously short span.
I do not believe this at all. I think you'd have to have a very limited experience working with other human beings to be able to believe this.
> and by training it better.
"Oh yea, just do it _better_. That's your problem." Perhaps some people operate without any context but most of us find the experience lacking.