SWE Bench Pro is completely different benchmark than SWE Bench (e.g. Verified) suite was. It only copied the name.
SWE Bench Pro is also gamed and shouldn't be trusted.
alt Hacker News
SWE Bench Pro is also gamed and shouldn't be trusted.