logoalt Hacker News

cool_dude85yesterday at 6:22 PM2 repliesview on HN

The chart is as non-specific as could be. It improved in some very vague metric by some amount at different (increasing) levels of training.


Replies

merksittichyesterday at 8:13 PM

The x-axis label of the chart is test-time compute. Doesn't this relate to inference ("thinking level") instead of training?

blake__devyesterday at 6:41 PM

That's fair, but at least the chart has an axis. :) Since openai just released astra, I was more surprised that they would publicly show any gap to their (presumably SOTA) internal model.