logoalt Hacker News

hartatoryesterday at 9:13 PM1 replyview on HN

I am noting Opus 5 is omitted. Interesting as I thought it benched better than Fable 5 in a few benchmarks.


Replies

paxysyesterday at 10:44 PM

The Opus 5 release was a perfect example of how useless these benchmarks are for a head to head model comparison. Anthropic published a post showing Opus 5 beating Fable in almost every eval but then added a disclaimer that it was still a tier below Fable in intelligence (and thus pricing). So then what did all the numbers represent exactly?