logoalt Hacker News

OutOfHereyesterday at 2:41 PM2 repliesview on HN

Did Anthropic give you third-party benchmarks? Is that what you said to them? Yes, they're important, but the attitude is wrong.


Replies

bloppeyesterday at 2:47 PM

Anthropic always publishes 3p benchmarks every time they announce a new model

show 2 replies
fwipsyyesterday at 6:30 PM

Fudging benchmarks is a cheap way to get attention. If the model is really that good, it will have plenty of attention soon enough.

show 1 reply