logoalt Hacker News

giancarlostorotoday at 11:31 AM1 replyview on HN

1m is too high, they used to autocompact a little too soon, maybe I tweaked defaults, it was kind of annoying, 200k tokens is too soon for me, I feel like the sweet spot is around 400k tokens.

Funnily enough Groks API charges less when you are below 400k tokens.

Half a million can get you reasonably far with enough of your codebase within the models context window.

I lowkey blame the 1m context window as the start of Anthropics worse woes earlier this year.


Replies

conceptiontoday at 12:46 PM

You can change your compaction token limit to 400k if you want.

CLAUDE_AUTOCOMPACT_PCT_OVERRIDE

And

CLAUDE_CODE_AUTO_COMPACT_WINDOW