logoalt Hacker News

Zambyte • yesterday at 11:15 PM • 2 replies • view on HN

What hardware do you run Qwen 3.8 Flash Next on?


Replies

solaire_oa • yesterday at 11:32 PM

I also run Qwen3.8 Flash Next "locally at home", on a Framework Desktop, so Strix Halo and 128GB... we're not talking laptops, exactly, if that's what you wanted to know.

Still, the halogen version only occupies < 40GB RAM on my machine (which is surprising... the Q4 takes over 100GB), so perhaps a 64GB version is on the table.

girvo • yesterday at 11:34 PM

A DGX Spark-like, the Asus GX10. I’m kicking myself that I didn’t buy a second one when I thought about it months ago, but Nvidia’s NVFP4 quantisation of Flash Next and offloading the ngram table to NVMe has worked well