logoalt Hacker News

bloppeyesterday at 2:47 PM2 repliesview on HN

Anthropic always publishes 3p benchmarks every time they announce a new model


Replies

MostlyStableyesterday at 2:52 PM

And even if they didn't, they have a track record. Even if we did have benchmarks in this case I would still wait until people got there hands on it and formed a more holistic opinion.

OutOfHeretoday at 12:09 AM

No, stop right there. Anything published by Anthropic implicitly is not third party. For it to be third party, the third party has to be the one publishing it.