logoalt Hacker News

nightpoolyesterday at 10:16 PM0 repliesview on HN

Your comment makes sense but I'm pretty sure yreg is saying the opposite of that—that their task is harder than the benchmark currently is.

(see their follow-up reply: "The cheapest-per-benchmark-task model would be useless to me if it cannot do the task I need.")

In either case, you need the right benchmark for the right task