These are very interesting results, and honestly hard to believe, even as a big 0731 fan.

If I'm reading the chart correctly, a couple observations:

* deepseek-v4-flash-0731 max is better than kimi-k3 max

* glm-5.2 is dumber than a box of rocks (this must be on low reasoning or something, right?)

This is way more extreme than other results I'm seeing, like those from Artificial Analysis.