logoalt Hacker News

babelfish • today at 6:15 PM • 3 replies • view on HN

Taking the benchmarks in the article at face value, this is ~on par with Opus 5.5 for ~1/4 the price!


Replies

mwigdahl • today at 6:20 PM

Which is why I don't take the benchmarks at face value...

➕ show 1 reply
entrope • today at 6:45 PM

Taking the benchmarks (as reported by OpenAI) at face value, why wouldn't they show Opus 5.5 on the OS world benchmark, and show no Anthropic models at all on the "factual error rate" benchmark

enraged_camel • today at 6:19 PM

...no it's not? At max effort, it scores 50% on terminal bench vs. Opus 5.5's 70%.

➕ show 1 reply