For reference, Mimo-v2.5-Pro scored 19% on DeepSWE 1.1. This is looking great.
Fable scores 70%, Kimi K3 69%, Astra 74% (all on max effort).
https://deepswe.datacurve.ai/blog/deepswe-v1-1
2.6-pro just reached 63.7% by step 10, it's on step 11 right now.
Even flash reached 60.7% by step 12, and it's on step 16 now.
This is so exciting lmao.
2.6-pro just reached 63.7% by step 10, it's on step 11 right now.
Even flash reached 60.7% by step 12, and it's on step 16 now.
This is so exciting lmao.