alt Hacker NewsPerhaps model size and reasoning length trade off to some extent, similar to CPU vs. RAM. A smaller model with a longer reasoning trace has more intermediate structure to latch onto and build on.
Perhaps model size and reasoning length trade off to some extent, similar to CPU vs. RAM. A smaller model with a longer reasoning trace has more intermediate structure to latch onto and build on.
Makes sense to me.
We will see, since if true then it is likely the other makers of small, dense models will copy it and include high reasoning by default.
If that also makes the other dense open source models better, then you are probably correct.