logoalt Hacker News

MostlyStabletoday at 7:26 PM1 replyview on HN

He was remarking on how unbelievable it was. He sentence is a little bit hard to parse but he's saying that both 5.5 being better than 5.6 AND Gemini 3.6 scoring better than both are signs that this benchmark is not very useful.

The reason for both of those things is, as you point out, the benchmark is very obviously saturated


Replies

zuzululutoday at 8:35 PM

ah fair enough , 5.5 being better than 5.6 is just plain wrong and yeah makes everyone skeptical