alt Hacker NewsIs there a reason we can't use thinking completions to train non-thinking? i.e. gradient descent towards what thinking would have answered?
Is there a reason we can't use thinking completions to train non-thinking? i.e. gradient descent towards what thinking would have answered?
From what I've read, that's already part of their training. They are scored based on each step of their reasoning and not just their solution. I don't know if it's still the case, but for the early reasoning models, the "reasoning" output was more of a GUI feature to entertain the user than an actual explanation of the steps being followed.