alt Hacker NewsIf I had the GPU size, hook it up to llama.cpp and setup the --reasoning-budget and reasoning-message; Most of that additional reasoning is a lot of garbage and you can redirect it to useful output.
That's how I handle the Qwen27B and 35B
If I had the GPU size, hook it up to llama.cpp and setup the --reasoning-budget and reasoning-message; Most of that additional reasoning is a lot of garbage and you can redirect it to useful output.
That's how I handle the Qwen27B and 35B
> Most of that additional reasoning is a lot of garbage and you can redirect it to useful output.
What do you mean by "redirect it to useful output"? Could you give an example? This sounds interesting.