alt Hacker NewsOpus 4.7 is also worse at 256K context. Go look at page 195 and page 196. It is across the board regression, not just 1M context.
Replies
timvb • yesterday at 9:22 PM
what's all this mean in real world use?
Opus 4.7 is also worse at 256K context. Go look at page 195 and page 196. It is across the board regression, not just 1M context.
what's all this mean in real world use?
Thanks, interesting. Does this make it more surprising that the other benchmarks have improved? I'm not sure I understand the benchmarks well enough - but I'm wondering whether with agentic workflows it's possible to get away with a smaller more focussed context (and hence lower cost) whilst achieving the same or better performance, because of agentic model's ability to decide what the put in context as they work