logoalt Hacker News

umanwizardyesterday at 7:37 PM1 replyview on HN

Please define what "predicting the next token" means. The next token according to what probability distribution? Couldn't every process that produces text (including humans writing) be modeled as predicting the next token according to some distribution?


Replies

white_dragon88today at 1:55 AM

[dead]