logoalt Hacker News

delicious_apple • today at 1:11 AM • 2 replies • view on HN

I don't agree with that conclusion. I'm looking at the benchmarks page for LFM2.5-24B-A2B, and it appears to get a worse score on SWE-Bench-Verified (by a lot) when compared to Qwen 3.6 35B-A3B. It only clearly beats Qwen 3.6 35B on AutomationBench, ToolSandbox, and LiveClaw.

At least for my use cases, Qwen 3.6 35B-A3B appears better than this new release. An MoE for Qwen 3.8 would be even better than that!


Replies

selcuka • today at 1:41 AM

Would you call Qwen 3.6 35B "similar size" with ~50% more parameters (both active and total) though? I believe what GP meant that if there was a Qwen 3.8 24B-A2B, it would roughly be as intelligent as this one.

onlyrealcuzzo • today at 1:19 AM

Way more excited for Nvidia's A9B model coming out tomorrow.

➕ show 1 reply