logoalt Hacker News

bel8yesterday at 5:45 PM2 repliesview on HN

With billions/trillions of dollars floating around, is it hard to imagine benchmarks could be biased?

I think it's safe to assume everything AI related is heavily biased until proven otherwise. Just like in pharma.


Replies

camdenreslinkyesterday at 6:22 PM

People game benchmarks for fake internet points to get their favorite web framework to the top of the list. I'm pretty sure they will do it for billions of dollars.

anthonypasqyesterday at 7:04 PM

you didnt answer my question. Why would cognition be biased towards making anthropic look good?

show 1 reply