Open-weight models
Kimi K3.1 Pro: −9
DeepSeek V4.1 Flash 1017: −13
GLM-5.3: −13
MiMo-V2.6-Pro: −16
Proprietary models
GPT-6 Astra: +4
GPT-6.1 Sol: +3
GPT-6.1 Terra: +3
Claude Opus 5.5: 0
Claude Sonnet 5.5: −2
Claude Fable 5.1: −3
Gemini 4 Argon (high): −3
Muse Wonder Full: −6
Claude Haiku 5.5: −7
Muse Wonder: −9
Gemini 3.8 Flash (high): −10
Grok 4.7 (high): −11
Is there affiliation with OpenAI or coincidence?
Yeah, this smells. Ain't no way Terra went up and Deepseek so far low. I have had the later beat the former on multiple criteria by simply being less distracted.
There was a thread here about families of models responding in the same patterns to specific queries like "say a random word", and it takes less than two minutes to verify it is true. It'll take a bit of effort to not convince me this change wasn't reverse-benchmaxxed to screw everyone other than OpenAI. I'll be less distrustful after everyone is done IPO-ing.