logoalt Hacker News

jjcm • today at 9:41 PM • 0 replies • view on HN

> Warning: AI benchmarks. Please don't trust them

I like that they're being up front about this. Benchmarks are a metric that can be gamed. They give you an approximate estimate of where things land, but you really need to test for your use case.