alt Hacker NewsShow the training set, and PROVE that the tasks and answers aren't in there. I don't understand why this is not a default first step for proving that this is creating new knowledge.
Replies
thatguysaguy • today at 1:39 AM
Are you claiming that for the open problems they give record-breaking solutions for, there were just answers on the web waiting to be found?
➕ show 1 reply
thw09j9m • today at 3:09 AM
It's Google. Assume the training set contains, as a subset, the entirety of all public digitized information. How would you like to them to share it?
➕ show 2 replies
tananaev • today at 12:41 AM
How can you actually verify it, even if they provide something?
➕ show 1 reply
Well that's harder than maybe solving well-known open problems (whose soln's are presumably not in training set lol) but it seems that their examples are not clearly breaking sota, especially on matmul