logoalt Hacker News

mannykannottoday at 3:08 AM1 replyview on HN

Yes - a point supported the Vera benchmark: https://github.com/aallan/vera-bench


Replies

kgeisttoday at 10:19 AM

The benchmark is strange: single-run results (the author acknowledges it's unreliable) and uses older models like GPT-4o or Opus 4 (although the benchmark is from 2026).