logoalt Hacker News

ghilston • today at 4:12 PM • 2 replies • view on HN

What would you personally recommend for those that have 128 GB?


Replies

nolok • today at 6:17 PM

I have a Ryzen AI Max+ 395 with 128 GB for running those sort of "background task", and my sweet spot is currently Qwen3.8 Flash-Next IQ4 at 96 GB.

seanmcdirmid • today at 6:00 PM

if you have 128 GB, you could use Qwen Flash Next at some reasonable quant, with the new SSD hack for only keeping some of the model resident in memory.