alt Hacker NewsThis is with the caveat that OpenAI uses their own harness for this:
> On ARC-AGI-3, GPT-6 Astra was run with our responses API harness , which changes two settings to better match real-world performance. The changes do not specifically target ARC-AGI-3.
Replies
simianwords • today at 7:47 PM
This should be normalised and expected - the responses API harness allows it to use the custom compaction that is not allowed otherwise. It is entirely fair to allow OpenAI to use their own compaction algorithm..
➕ show 1 reply
Its 62 percent when using a neutral harness. https://arcprize.org/blog/astra