alt Hacker NewsYou’d never be able to update it’s knowledge.
LLMs need retraining to incorporate new knowledge.
Baking them into wafers means they will be out of date by the time they finish the first wafers.
You’d never be able to update it’s knowledge.
LLMs need retraining to incorporate new knowledge.
Baking them into wafers means they will be out of date by the time they finish the first wafers.
Yes, of course, but all the LLMs are already out of date, so that doesn't seem to me to be a hard limiting factor. Even if they had a knowledge basis ~3 months out of date additionally, being able to serve 100x the requests per watt seems totally reasonable to me.