logoalt Hacker News

cubefoxtoday at 8:34 AM0 repliesview on HN

> Basically like passes@6 or passes@5 if you’re doing a benchmark, except for your real tasks.

It's unclear how they would do this when there is no signal that provides an objective ground truth.