> with 184 tokens/s on an Apple M5 Max
That seems pretty decent. How many tokens/s do you need for a coding agent to feel like Claude or codex?
>How many tokens/s do you need for a coding agent to feel like Claude or codex?
it's kind of a loaded question, this model gets a lot of tok/s but reasoning is forced on; the time-to-answer is really a combination of things like "how much does this thing want to over-reason" and "how much does this thing like tool use?" .
AFAIU prefill speed makes a bigger difference in agentic coding workflows as the harness likely spends more time reading than creating new code. Qwen in particular spends a lot of time reasoning so it does make a larger impact there
I’d say only 65
Claude code is 60-80 tps, codex varies by model but mostly 40-50 tps.