logoalt Hacker News

peri-cltoday at 6:34 PM1 replyview on HN

[self-reply because comment edit window ended]: I now have a head-to-head benchmark. On my wheezy laptop (specs in sibling comment), this new dense model, Qwen 3.8 27B, gets ~4 tokens/second on generation. The older mixture-of-experts model, Qwen 3.6-35B-A3B, gets ~20 tokens/s.

MoE is literally 5x times faster (on CPU) than comparable dense Qwen!

Tested:

Qwen3.6-35B-A3B-UD-Q4_K_XL

Qwen3.8-27B-UD-Q4_K_XL


Replies

qeternitytoday at 7:45 PM

35A3 might be more comparable to 10 dense.

27 dense is far more capable than 35A3.

show 1 reply