logoalt Hacker News

paxysyesterday at 10:44 PM0 repliesview on HN

The Opus 5 release was a perfect example of how useless these benchmarks are for a head to head model comparison. Anthropic published a post showing Opus 5 beating Fable in almost every eval but then added a disclaimer that it was still a tier below Fable in intelligence (and thus pricing). So then what did all the numbers represent exactly?