logoalt Hacker News

hatthew • today at 1:09 AM • 2 replies • view on HN

My comment about humanity's last exam being a misnomer is included, and I proposed better ideas about what a last exam could look like. One of the things I said was "solve an open math problem" which has conclusively been done with Navier-Stokes (regardless of the controversy surrounding that). However, in the spirit of clarifying the goalposts, AI has only passed 1/6 of the tests I proposed. 17% is not a passing grade, so I'd say no, my challenge has not been met.

Another thing to note is that the (presumably AI-generated) summary of my challenge does not accurately represent what I wrote, listing only half the things I said and saying "or" rather than "and".


Replies

hexapus • today at 2:46 AM

You should add an additional item: Be able to relay the contents of this exam accurately.

andrepd • today at 6:00 AM

> "solve an open math problem" which has conclusively been done with Navier-Stokes (regardless of the controversy surrounding that).

In the same breath you recognise there is a controversy (there are actually several orthogonal ones!), and yet you call it "conclusive"... Very strange!