alt Hacker Newsit does not require training a model from scratch for it to be updated. the entire LLM training process is iterative. essentially each step (there are hundreds/thousands for a training run) yields a complete, usable model. tokens with updated data can be added on top essentially at any time in the future.
That's good to know, but I think maybe the bulk of the original point is still concentrated in the "we always need new models to stay relevant" piece.