logoalt Hacker News

Zambyte • today at 1:36 PM • 2 replies • view on HN

24 GB 7900 XTX user here. You can do a ton with less than 32 GB. It definitely drops off quick, but 32 GB is not the floor for useful AI.


Replies

jacquesm • today at 1:41 PM

Realistically I think 16GB is the lower limit and you can find those cheap enough still. Then you run llama.cpp to bond your cards and it's off to the races.

Risse • today at 2:10 PM

24 GB 3090 user here. What is the best model for coding you have used? Qwen3.8 27B?

➕ show 2 replies