logoalt Hacker News

achompasyesterday at 10:25 PM2 repliesview on HN

I’m sorry but you’re demonstrably incorrect.

Listen, I want more open weight models in the world. They create entrepreneurial opportunities and support use cases which the foundation labs don’t want to support.

But open weight models are consistently three to six months behind on performance compared to closed models, as confirmed by both benchmarks and personal use. They’re closer on coding and much further away on non-coding tasks.

There are theories as to why these models lag, which I won’t get into. But anyone claiming open-weight models are close to closed-weight models is ignoring significant evidence to the contrary.


Replies

otabdeveloper4today at 5:34 AM

> three to six months behind on performance

Yeah, like I said - it's just a post-training difference. That's not a material difference, that's a difference of chrome and polish.

ninjagooyesterday at 10:39 PM

> I’m sorry but you’re demonstrably incorrect.

Please so demonstrate?

show 2 replies