logoalt Hacker News

zarzavat • today at 1:35 PM • 2 replies • view on HN

I don’t care and in my opinion AA does a disservice to their users by allowing such blatant manipulation. What would happen if every AI company were to include their unreleased models like this? Put the unreleased models on a separate page and leave the headline benchmark rankings for models that you can actually use.


Replies

dannyw • today at 1:42 PM

AA (like most other VC-funded benchmark sites) is pay-to-play.

Want a private benchmark and see where you'd rank? $$$.

Want to show up day 0? $$$$.

Want to show up day -0? $$$$$.

Copenjin • today at 2:21 PM

What the AA charts say is irrelevant to me.