logoalt Hacker News

dannyw • today at 8:22 AM • 2 replies • view on HN

From my rough recollection, all 3 of the past updates all had the effects of decreasing the score of open weight models.

One was rushed and same-day updated as GLM 5.3 (iirc) got added; of course its main change to rankings was lower GLM scores.


Replies

mzl • today at 9:21 AM

Such releases often show weaknesses if the intelligence index, because the models that are ranked jointly do not have the same percieved level of quality.

singularity2001 • today at 9:32 AM

So instead of the narrative of benchmaxing, in truth it's benchminimizing of competitors by the U.S. oligarchy?