logoalt Hacker News

finn888today at 1:53 AM0 repliesview on HN

Averaging pass@1 across eight runs per task is useful; it exposes harness consistency instead of letting one lucky resolution dominate.