alt Hacker NewsBut the chain of thought as text can be elusive, no? It might not be related with the actual "reasoning" of the model. There was a paper about this.
But the chain of thought as text can be elusive, no? It might not be related with the actual "reasoning" of the model. There was a paper about this.
This is correct, the decoded text has nothing to do w/ calculations that eventually get decoded into text. It's just a veneer that gives the appearance of legibility.