logoalt Hacker News

andriy_kovalyesterday at 10:37 PM1 replyview on HN

ARC leaderboard has results from semi-private data for frontier models, they have another competition for private data.

It is described in their methodology: https://arcprize.org/policy

It makes sense, since once OpenAI API receive task, it is not private anymore but leaked to OpenAI.


Replies

tintortoday at 2:33 AM

Where are results for private data?

Which LLMs participate on private set? Open weight LLMs only?

show 1 reply