logoalt Hacker News

red75primetoday at 12:48 AM0 repliesview on HN

Next token prediction is a pretraining objective that doesn't tell anything about behavior and activation structure of the resultant network. The literature that explores a hallucination problem has little to do with your claim about physical impossibility.