logoalt Hacker News

taneq • yesterday at 11:16 PM • 1 reply • view on HN

Calling it ‘next-token prediction’ is missing the forest for the trees. The reason prediction gives rise to so many capabilities is that to effectively predict something requires modelling the entities involved and their capabilities. You can’t predict a cat’s next action without knowing how to chase a mouse.


Replies

monk_grilla • yesterday at 11:34 PM

This is a really useful and succinct explanation, I'll be using it, thanks!