logoalt Hacker News

jkingsman • today at 6:53 PM • 0 replies • view on HN

I'm across a Pro 6000, 2x3090, and 128GB sys RAM (built a while back; I could not afford that these days heh). I get ~1-3ktok/s prefill, ~120tok/s decode.

When I had only twin 3090s, I made heavy use of Qwen 3.5 27b.