alt Hacker Newscode clash I think would be quite hard to game or contaminate unintentionally; considering that models need to compete against one another
Replies
Bombthecat • yesterday at 6:53 PM
I mean the data / benchmarks
code clash I think would be quite hard to game or contaminate unintentionally; considering that models need to compete against one another
I mean the data / benchmarks
https://gertlabs.com already does this at scale.
An industry-standard benchmark shouldn't be hosted or designed by a lab producing the models, regardless.