logoalt Hacker News

satvikpendemyesterday at 2:55 PM1 replyview on HN

That should be covered by the harness rather than the LLM itself, no? Compaction and summarization should be able to allow the LLM to still run smoothly even on large contexts.


Replies

hu3yesterday at 5:43 PM

Sometimes it really needs a lot of data to work.