logoalt Hacker News

slopinthebagtoday at 5:42 PM0 repliesview on HN

Idk about end of the road, I’m sure they can squeeze out some more performance by curating even more data and doing even more RL.

But I would bet that pretty much all of the improvement we’ve seen over the last year with coding has come from RL, not from the models becoming particularly stronger. And this makes sense, if models grow sublinearly with compute. And it seems like they do.