Feels like they discovers that if you build your own benchmark, you can win it
Pretty sure most benchmarks are being gamed by people training on the test set deliberately or accidentally anyway.
alt Hacker News
Pretty sure most benchmarks are being gamed by people training on the test set deliberately or accidentally anyway.