logoalt Hacker News

alex43578 • today at 1:56 PM • 0 replies • view on HN

It seems a ton of the chain of thought tokens are English. It just processes weights, though, not tokens - maybe compute efficiency for using "cached" tokens/weights or it more efficiently learned to process English tokens by virtue of their greater weight in the corpus.