logoalt Hacker News

jackxlautoday at 8:17 AM0 repliesview on HN

In my own testing I have seen peak performance happen usually within 15-20% of the intended context limit, albeit there are a few optimizations depending on the task quality.