logoalt Hacker News

dackdeltoday at 4:00 PM3 repliesview on HN

what kind of hardware do you need in order to run qwen3.6-27b


Replies

giancarlostorotoday at 4:19 PM

Depends on which variant you pull down, but a single 5090 GPU (I know these are insanely expensive, but for context) could run either the Q8 or Q4_K_M version. It will not fit the 52GB version (BF16) on the other hand. So any modern Mac with a Pro or better processor and more than 52GB of RAM (don't forget VRAM for context window also matters!) would suffice, as someone else noted, probably a 128GB model would do the trick, and give you enough wiggle room to max out the context window.

My Mac only has 16GB of VRAM (20GB total - 8 is reserved for the OS) so I have to leave room for VRAM, I usually find a model that fits in 5 to 7 GB of VRAM and then max the context window as much as I can.

show 2 replies
sbmthakurtoday at 4:10 PM

I could run it on 7900 XT with 64k context. You could run it more comfortably on a 24 gb vram.

iagooartoday at 4:04 PM

I recommend MacBook M5 Max with 128 GB of RAM to run it comfortably and fast. If you have something like a regular M4, go with qwen3.6-35b-a3d - the Mixture of Expert architecture makes it run 2-3x faster than the 27b version.