alt Hacker NewsAs a comparison, Qwen3.6 27B scores 38, which was the highest in its small model category (4B–40B).
Qwen3.8 27B beats all medium models (40B–150B). It has the same score as DeepSeek V4 Flash 0731, which ranks #5 in large model category (> 150B).
Sources:
- https://artificialanalysis.ai/models/open-source/small
Replies
bermudi • today at 10:24 PM
This only makes me understand how flawed AAII is. This Qwen model is nowhere close to the other models in that score range.
kzrdude • today at 6:58 PM
It's fun to see "test time" scaling work out so well, maybe the best example of all.
Simon Willison's post about this gives a good context on why exactly this is happening. While it doesn't mention this in the Artificial Analysis page, this is likely with Max reasoning, which has extremely long reasoning traces:
https://simonwillison.net/2026/Aug/16/qwen-38-27b/
It seems like the token usage is 2.3x GPT Luna Max and almost 2x Kimi K3!
https://imgur.com/a/dDSyhr2
I'm curious if they can make up for this with insanely high tokens-per-second especially when served from hosted providers, though, given how tiny it is (37B!)