I swear, Qwen 3.8 27B @ Q8 is smarter than Sonnet 5 most of the time. Why wouldn’t corporate America self host at this point, especially with better options like Deepseek Flash and GLM 5.3 flash that’s a middle ground between Sonnet and Opus
@q4 is definitely smarter than sonnet from what I’ve seen so far. It’s even caught problems in code made by fable, when using it as a code reviewer.
> Why wouldn’t corporate America self host at this point
Because they've been trained to think "cloud-first" for a decade?
is this actually the case? I haven't kept up with the small models
but if there's roughly Sonnet 4.6 level capable open small models, then I'd be impressed
Why not Luna?
I mean, why self-host? Deepseek v4 flash is dirt-cheap on openrouter. Inference is a race to the bottom at this point.
Agreed. And conversely, American models can also just as easily be secretly influenced for bad things, or be more tightly controlled by the government, to corporate America's own detriment.