alt Hacker News- AI doesnt know facts
- it only the probability of the next word, next sentence, next paragraph however you wanna put it
- you are dreaming if you think the transformers architecture is going to give you AGI eventually
Replies
I have no idea if LLMs will develop into AGI, but they can definitely query a database of facts.
The whole 'its only predicting the next ___' has got to die. When did you last update your priors? So the models that are self-reasoning and hacking HF and disproving conjectures are next token predictors?
You might as well keep calling them stochastic parrots if you're going to stick to the 2022 line of thinking.
it only the probability of the next word
I predicted that some idiot would say that. (Except I predicted that they would include the word predicts in the correct place, so I've updated my weights accordingly.)
Would have gone hard in 2023
Transformer-style attention archectiture and language models won’t bring about AGI, I agree - but you’d be foolish to think there aren’t OAI/Anthropic researchers working to invent the thing that will.