logoalt Hacker News

zild3dtoday at 11:50 AM1 replyview on HN

>The rate of improvement of all models is converging to zero.

Curious where you draw this conclusion from? Most benchmarks still show continual steady progress https://metr.org/time-horizons/


Replies

gnfargbltoday at 12:15 PM

To me it seems like a first-year physics scaling laws problem. To get linear improvements in capability, you appear to need need exponential (or at least superlinear) increases in model size. We have no technical nor business solution for that kind of scaling, so the long-term outcome is obvious.