logoalt Hacker News

NitpickLawyertoday at 7:24 AM1 replyview on HN

> people built harnesses that solves arc agi 3,

They didn't. Kaggle is still running for a few more months, best result atm is ~2% with 9h runtime on one rtx6kPRO. Also note that these new results are on the semi-private set, not the public 25 games ones. Any announcement where you see "solved ARC3" is likely only dealing with the 25 public games. And that's highly questionable, until you get to see the code. (which, to my knowledge the team that claimed 99% hasn't yet published).


Replies

haldujaitoday at 7:38 AM

For frontier models, not local.

https://schema-harness.github.io/

show 1 reply