logoalt Hacker News

wmf • yesterday at 7:41 PM • 6 replies • view on HN

Congratulations I guess but it's a pretty bad look to not even mention those other open weight models.


Replies

karmakaze • yesterday at 8:00 PM

What's funnier is that after cherry picking models for comparison, they further cherry picked Inking for size comparison instead of better and smaller Beam 1.0

The bar chart also shows Nemotron 3 Ultra instead of smaller and better Nemotron 3.5 Super.

tedivm • yesterday at 7:46 PM

We've always been at war with eurasia.

Seriously though, it's just easier to pretend that China doesn't exist when they're stomping us this badly.

stewartpark • yesterday at 8:51 PM

I think it's because the primary users of this model won't even look at "those other open weight models" as options. This is the right chart to present to those who would consider this model. (e.g. US Gov't agencies, chip design industry, etc etc)

flatline • yesterday at 7:46 PM

Right? These are not likely to be meaningful points of comparison to anyone but the authors.

➕ show 1 reply
schleck8 • yesterday at 9:04 PM

Because Chinese models heavily rely on distillation and regularly behave strangely in public benchmarks (where they score much better than in private evaluations), even if many world class researchers are Chinese. It's difficult to quantify to what extend labs like Moonshot would be competitive if they could not distill from OpenAI, now that Anthropic mostly blocks it

https://www.theinformation.com/articles/openais-astra-model-...

petcat • yesterday at 8:40 PM

Do those other models usually mention all the competition? I haven't noticed