logoalt Hacker News

stri8tedyesterday at 5:18 PM3 repliesview on HN

Exactly. As far as I'm concerned, the benchmark is useless. It's way too easy and rewarding to train on it.


Replies

bonoboTPyesterday at 7:33 PM

It's just an in-joke, he doesn't intend it as a serious benchmark anymore. I think it's funny.

Legend2440yesterday at 5:44 PM

Y'all are way too skeptical, no matter what cool thing AI does you'll make up an excuse for how they must somehow be cheating.

show 2 replies
pixl97yesterday at 5:46 PM

I mean if you want to make your own benchmark, simply don't make it public and don't do it often. If your salamander on skis or whatever gets better with time it likely has nothing to do with being benchmaxxed.