logoalt Hacker News

altmanaltmantoday at 4:38 PM1 replyview on HN

"Benchmark is stupid" and "model beats model on benchmark" are two different things, though. The second one is objectively true regardless of your views on the first one, right? To expect everyone to share your opinion that benchmarks are stupid is pretty weird, and just saying "no" to an objective truth is the definition of delusion.


Replies

kennywinkertoday at 5:56 PM

If a benchmark is a measure of nothing useful, then model beats model is an objectively useless fact

show 1 reply