alt Hacker NewsThe top 4 models on that site are all variants of Gemini Flash? That does not match my experience at all.
Replies
markasoftware • yesterday at 9:20 PM
yep, the person you're responding to created the benchmark and is using HN comments as advertisement.
➕ show 1 reply
I should add a F.a.q. for this question.
The suite is across many categories, not only coding, and most of the tasks are low-horizon (or what the opposite of long-horizon is), where the max thinking time is around 10 minutes.
Gemini models are really smart, unfortunately they don't play well with any harness, so hard to use in practice.
But try them out for one-shot tasks, they are really good. Don't use them for coding in a harness, but you can ask them to generate code/planning (still, for coding only other models are indeed recommended).