logoalt Hacker News

rubslopes • today at 10:46 AM • 1 reply • view on HN

If they don't care, why are them presenting them when launching a new model, every single time?


Replies

embedding-shape • today at 11:04 AM

Because people, for some stupid reasons, still read and make decisions by these public benchmarks, which makes zero sense. Create your own benchmarks and evaluations, then use those, it's pretty the only way to get any qualitative answers to how well a model will work for you and your user cases.

➕ show 1 reply