alt Hacker NewsNot sure why they don't compare with others, but they are actually leading on the benchmarks they published. See here (bottom) for a chart comparing to other models: https://marginlab.ai/blog/swe-bench-deep-dive/
Replies
mistercheph • last Thursday at 7:34 PM
It's like apple, they just don't want users or anyone to even be thinking of their competitors, the competition doesn't exist, it's not relevant.
is swe-bench saturated? or they switch to swe-bench pro because...?