Is that any different from an LLM having a context window?
Yes, LLMs don't think on their own, for one; they think when you invoke them.
alt Hacker News
Yes, LLMs don't think on their own, for one; they think when you invoke them.