logoalt Hacker News

Running Qwen3.8-Flash-Next NVFP4 at 184 tok/s on a single RTX 6000 Pro

13 points • by matteohorvath • yesterday at 10:17 PM • 3 comments • view on HN

Comments

IronWolve • today at 2:59 AM

Been running versions of this on my pc, if you have 64 gigs ram, you can run it on a 12+ gig cards easily.

lowbloodsugar • today at 12:58 AM

Been running Qwen3.8-Flash-Next NVFP4 for weeks now. What's new about this?

➕ show 1 reply