logoalt Hacker News

whstltoday at 9:54 AM1 replyview on HN

If compaction is throwing away crucial prompting instructions even when it's at a 1% of maximum token usage (like my example), then it's a software bug, not an LLM artifact.


Replies

taconetoday at 11:59 AM

Doesn't compaction invalidate token caching, btw?