logoalt Hacker News

raincoletoday at 10:54 AM1 replyview on HN

People though asking LLM to output the reasoning steps was astrology until it's standardized and made ubiquitous.


Replies

andaitoday at 2:22 PM

Didn't multiple studies find the reasoning traces didn't have much to do with the final output? And even that outputting placeholder tokens during reasoning has a similar beneficial effect on benchmark scores?

(I don't think that's the full picture but, there's definitely something fishy going on there.)