alt Hacker NewsI agree, there’s the collective intelligence that created all the content used to train the model. The model is a superposition of all that material with RL tuning. Analogously to reading a book, the intelligence you perceive is from the book’s creator.
What about DNA? There are things we do that we never read in a book, maybe never seen someone else do them vefore, but we still do them. Or we still feel a certain way. That doesn't come from "human training data", unless you count the DNA as training data.