There is no training from scratch though. It's kind of, "first create the universe" framing pretention. All models rely heavily on the large corpus that humanity built through large span of time. And of course humanity didn't create the condition of its emergence.