logoalt Hacker News

seizethecheese • yesterday at 6:33 PM • 1 reply • view on HN

We allow early voting. This is against what most arenas do, but is on purpose. If the model is faster to do simple stuff, it should be chosen. In this sense, DS4.1-Flash is better on many tasks.

You can remove early voting from leaderboard and they are no longer the same.


Replies

nostrebored • yesterday at 11:05 PM

But how do you verify a fair or representative distribution of complexity?