alt Hacker NewsThere was a time when people were running less-capable minicomputers, but the future was mainframes.
There was a time when people were running microcomputers, but they were just toys; the future was mainframes and minis to do real work.
The way tech goes is that the "toys" become real. They become where the action is. The bigger stuff doesn't go away - there are still mainframes, even today - but the action moved on to microcomputers, and then to phones.
There will still be "big" models, but don't dismiss models on a chip because they are "toys".
Note well: I do not claim that models on a chip will certainly follow that trajectory. All I'm saying is that, given the trends in tech over the last several decades, don't dismiss them just because they are toys.
I don't see the microprocessor comparison here. Dedicated inference ASICs already have a great chip design parallel - ASICs. Most PCs and smartphones avoid ASICs entirely to control things via the SOC if possible. The most popular modern microprocessors are all generally not ASIC designs.
Crypto miners already charged down this route for mining, and now there are thousands of ASIC mining rigs that are worth nothing, when GPU rigs are resold at a profit. ASICs are a dead-end, and I think that's why Nvidia couldn't give a rats ass what Taalas builds.