https://marginlab.ai/trackers/claude-code/ their tracker generally shows that isn’t the case. The only times I’ve seen it drop is something broken and just before fable launched.
I mean they could just be routing known benchmark questions (which all of SWEBench are) to a full-performance variant.
I mean they could just be routing known benchmark questions (which all of SWEBench are) to a full-performance variant.