logoalt Hacker News

aliljettoday at 12:42 AM1 replyview on HN

Are there evals showing how this improves outputs?


Replies

apetresctoday at 1:27 AM

Improves outputs relative to what? Compared to previous contexts of 1M, it improves outputs by allowing them to exist (because previously you couldn't exceed 200K). Compared to contexts of <200K, it degrades outputs rather than improves them, but that's what you'd expect from longer contexts. It's still better than compaction, which was previously the alternative.