logoalt Hacker News

purplemantis • yesterday at 8:56 PM • 0 replies • view on HN

These are pretty odd benchmarks to use. Terminal Bench 2.1 is old. SWE-bench was disavowed by OpenAI. DeepSWE is clearly benchmark-hacked by Gemini.