logoalt Hacker News

chvid • today at 7:08 AM • 0 replies • view on HN

"The FrontierCode verifier grades each attempt with the task's tests and rubric. We use GPT-6 Luna (medium) as the LLM judge"

Why are they using a closed source LLM as a judge? Closed source providers can see your traffic and adjust as they see fit.