alt Hacker NewsThe whole point of his model is to optimize for a very specific benchmark.
BUT, he does not use labels when training, so the model does not know the answers.
The whole point of his model is to optimize for a very specific benchmark.
BUT, he does not use labels when training, so the model does not know the answers.
> The whole point of his model is to optimize for a very specific benchmark.
But benchmaxxing is what we generally try to avoid for training, as there is no point really for it. We used to call it "overfitting", now you're saying this person does it intentionally? Why?