alt Hacker News>The scaling laws hold that a language model grows more capable with more parameters and more training data.
Which is a choice, not a "law":
https://arxiv.org/abs/2510.13786
>The scaling laws hold that a language model grows more capable with more parameters and more training data.
Which is a choice, not a "law":
https://arxiv.org/abs/2510.13786
I think this is partially true: scaling parameter size will always go asymptotic to 100% accuracy because 100% is the ceiling of that metric.
However 95% is still half the error rate of 90%, and 97.5% is half the error rate of that.
And when test time compute like reasoning and looping harnesses stack many inference acts with many tokens each, those seemingly small accuracy gains stack tremendously.