alt Hacker NewsHave you considered the other direction? They test a new model, and realize their current index is broken, so they improve it?
At the previous iterations they were accused of favoring OpenAI. Now they are accused of favoring Google.
Replies
pu_pe • today at 2:02 PM
And how do they realize their current index is broken? They either have some recency bias, or indeed favor the big American labs (more likely, since a new Chinese model topping the charts triggers a shakeup).
We’re literally talking about the same thing, but ascribing different motivations.
I do think the test a new model and realize their index is broken- the new model isn’t on top, so they change the weights to make sure it’s on top.
The difference is that you seem to think they are doing so out of some innocent feeling that the new model is actually better, while I think they are doing so because they were paid to do so. I think my interpretation is more likely, but that’s just me.