logoalt Hacker News

dgellowyesterday at 9:21 PM3 repliesview on HN

A bit of a meta question: what are the most relevant benchmarks by now?


Replies

redox99yesterday at 10:17 PM

Terminal bench 4 is good largely because it's recent so it hasn't been benchmaxxed yet. It's more of a sysadmin/devops benchmark than a coding benchmark though, but still a decent proxy.

https://artificialanalysis.ai/evaluations/terminalbench-v4-0

tetec1yesterday at 9:44 PM

Epoch.ai has a global score and tracks many benchmarks: https://epoch.ai/benchmarks

andriy_kovalyesterday at 9:37 PM

Nvidia and OpenAI claimed AGI, but you still have a job.