alt Hacker NewsDeepSWE scores 75.4 - that's the best score so far. And it's crazy cheap! Google held the top a few hours today with Gemini 3.8 Flash, but now second to Spark 1.3. All this competition will drive prices down!
Replies
cbg0 • today at 8:06 PM
But is the score really reflective of the quality or are both models benchmaxxing?
➕ show 1 reply
dominotw • today at 8:13 PM
how much of it is from reallocation of staff to ai training and labeling
With the contributor pricing being more than 10x cheaper than the standard, that would make it best and cheapest on the DeepSWE leaderboard! It feels fast in my experience too. LLMs keep improving at an insane pace.