10 years from now: "Can you believe they did anything with such a small context window?"
10 years from now: "The next big thing: HENG - Human Engineers! These make mistakes, but when they do, they can just learn from it and move on and never make it again! It's like magic! Almost as smart as GPT-63.3-Fast-Xtra-Ultra-Google23-v2-Mem-Quantum"
I am kind of already at that point. For all the complaining about context windows being stuffed with MCPs, I am curious what they are up to and how many MCPs they have that this is a problem.
"That was back when models were so slow and weighty they had to use cloud based versions. Now the same LLM power is available in my microwave"
More likely: "Can you believe they were actually trying to use LLMs for this?"