It's becoming increasingly clear that memory and context are the bottlenecks in advancing usage of AI. I can't help but feel there needs to be a general, perhaps even built into the model, solution for this - everyone seems to be building something on top that is roughly the same thing.
Karpathy had a similar interesting take the other day
https://x.com/karpathy/status/1921368644069765486