alt Hacker NewsBelow is the worst quote... It is plain wrong to see an LLM as a bags of words. LLMs pre-trained on large datasets of text are world models. LLMs post-trained with RL are RL-agents that use these modeling capabilities.
> We are in dire need of a better metaphor. Here’s my suggestion: instead of seeing AI as a sort of silicon homunculus, we should see it as a bag of words.
When you see a dog, or describe the entity, do you discuss the genetic makeup or the bone structure?
No, you describe the bark.
The end result is what counts. Training or not, it's just spewing predictive, relational text.