logoalt Hacker News

criley2last Saturday at 3:46 PM3 repliesview on HN

While it is true that model makers are increasingly trying to game benchmarks, it's also true that benchmark-chasing is lowering model quality. GPT 5, 5.1 and 5.2 have been nearly universally panned by almost every class of user, despite being a benchmark monster. In fact, the more OpenAI tries to benchmark-max, the worse their models seem to get.


Replies

astrangelast Saturday at 4:25 PM

Hm? 5.1 Thinking is much better than 4o or o3. Just don't use the instant model.

malnourishyesterday at 12:38 AM

5.2 is a solid model and I'm actually impressed with M365 copilot when using it.