While I don't disagree, memory certainly was more of a restrictions on us humans than it is on llms. Therefore, the answer may not be as obvious as it seems. We build abstractions to reduce (memory) footprint of features, right?
Humans built codebases many millions of lines long, well before LLMs existed. Human memory has not been a restriction on us in a long time.
Look at all the libraries full of books we've built. It's useful for more than mere training sets.
Humans built codebases many millions of lines long, well before LLMs existed. Human memory has not been a restriction on us in a long time.
Look at all the libraries full of books we've built. It's useful for more than mere training sets.