alt Hacker NewsThey scale with compute so even if today's frontier model equivalents work on future desktop hardware then the big servers will still have bigger and better models.
Replies
jhonof • today at 8:32 PM
Yes but at some point there is diminishing returns in model quality. Most people don't need a model that can solve Navier-Stokes to write emails for them.
The value of those models doesn't necessarily though. To extend the personal computer analogy, a server rack has always been more powerful than the average desktop computer but a personal computer got "good enough" at enough tasks that people just used those instead.