logoalt Hacker News

esafaktoday at 6:16 PM3 repliesview on HN

It's serviceable but, like many Chinese models, it uses a lot of tokens to get work done.


Replies

grueztoday at 6:56 PM

>it uses a lot of tokens to get work done.

That's irrelevant when you use $/task as the metric, which the OP does use.

show 1 reply
aitchnyutoday at 7:46 PM

It felt like a rocket compared to GLM 5.2 though. Are Chinese models generally token-heavy?

show 1 reply
cyanydeeztoday at 8:03 PM

If I had the GPU size, hook it up to llama.cpp and setup the --reasoning-budget and reasoning-message; Most of that additional reasoning is a lot of garbage and you can redirect it to useful output.

That's how I handle the Qwen27B and 35B

show 1 reply