logoalt Hacker News

xynelius • today at 5:15 PM • 0 replies • view on HN

I think it's safe to assume every single model is benchmaxxed. I mean why wouldn't you include training data from common benchmarks? Not only is a higher score good marketing, but these benchmarks are supposed to represent common tasks so training for those should in principle improve performance across a wider range of tasks.