It would make reading and comparing a bit easier if the data was sorted by a dimension.
Cost per task:
Model Score Cost / Task Output Tokens / Task ------------------------------------------------------------------------- Muse Spark 1.2 (xhigh) 56.8 $0.40 30,430 Gemini 3.7 Flash (high) 56.0 $0.40 36,847 GPT-5.6 Terra (max) 56.6 $0.51 20,838 GPT-5.6 Sol (high) 57.3 $0.52 7,545 GLM-5.2 (max) 53.0 $0.56 32,200 GLM-5.3 (max) 59.5 $0.68 41,107 GPT-5.5 (xhigh) 56.3 $0.69 16,893 Grok 4.6 (high) 60.9 $0.84 21,735 Kimi K3 (max) 59.7 $0.84 25,474 GPT-5.6 Sol (xhigh) 59.0 $0.87 11,098 Qwen3.8 2.4T A95B 57.7 $0.95 32,472 Claude Opus 5 (medium) 58.6 $0.98 12,459 Qwen3.8 Max 58.1 $1.13 38,287 GPT-5.6 Sol (max) 60.9 $1.23 16,879 Claude Opus 5 (high) 61.5 $1.52 21,353 Claude Opus 4.8 (max) 57.3 $1.65 33,557
Model Score Cost / Task Output Tokens / Task ------------------------------------------------------------------------- Claude Opus 5 (high) 61.5 $1.52 21,353 GPT-5.6 Sol (max) 60.9 $1.23 16,879 Grok 4.6 (high) 60.9 $0.84 21,735 Kimi K3 (max) 59.7 $0.84 25,474 GLM-5.3 (max) 59.5 $0.68 41,107 GPT-5.6 Sol (xhigh) 59.0 $0.87 11,098 Claude Opus 5 (medium) 58.6 $0.98 12,459 Qwen3.8 Max 58.1 $1.13 38,287 Qwen3.8 2.4T A95B 57.7 $0.95 32,472 Claude Opus 4.8 (max) 57.3 $1.65 33,557 GPT-5.6 Sol (high) 57.3 $0.52 7,545 Muse Spark 1.2 (xhigh) 56.8 $0.40 30,430 GPT-5.6 Terra (max) 56.6 $0.51 20,838 GPT-5.5 (xhigh) 56.3 $0.69 16,893 Gemini 3.7 Flash (high) 56.0 $0.40 36,847 GLM-5.2 (max) 53.0 $0.56 32,200
alt Hacker News
Cost per task:
Benchmark score: