logoalt Hacker News

roadside_picnicyesterday at 6:13 PM1 replyview on HN

What's the tokens/sec you're getting on that setup (genuinely curious because it's a setup I haven't actually run myself)?


Replies

wolttamyesterday at 7:06 PM

Using regular DeepSeek-V4-Flash, I see 2000tok/s prompt processing and from 40 to 50 tok/s generation. Performance doesn't drop much at long contexts, DSv4 is really nice for that.

With DeepSeek-V4-Flash-DSpark (Deepseek's new speculative decoding scheme), which is still barely supported anywhere, we're seeing a more steady 45-55 tok/s with bursts into the 60s.

show 1 reply