logoalt Hacker News

aliljettoday at 7:24 AM2 repliesview on HN

The benchmarks here are confusing at best. Am I reading correctly that this model is essentially as good or better than all frontier models right now?


Replies

anana_today at 7:42 AM

I believe the benchmark listed is about simulating the environment for the various tasks, rather than doing them. It seems that the point of this model is to generate sim data to improve other models with

blourvimtoday at 7:31 AM

Benchmarks in general are a little iffy, the whole industry is going off of vibes anyways. Can't decide before trying it out