logoalt Hacker News

lrvick • today at 7:34 PM • 0 replies • view on HN

For those asking in threads. 4x r9700s will cost about 6-8k depending on how patient you are with ebay auctions.

From there any motherboard and CPU that can give you 4x slots of 16x Gen 5 PCIe slots positioned such that you can install 4x cards is probably fine. Ideally with a CPU capable of memory encryption.

My latest pairing is a ASUS Pro WS W890E-SAGE SE For $800 open box, and a Xeon 654 for $1300. My first build was an AMD EPYC rig for similar cost a few months ago using a Gigabyte ME03-PE0 and a AMD EPYC Siena 8224P for about 2k combined. I specifically wanted one amd and one intel machine for reproducible build diversity which most probably do not care about.

Do not get too attached to specific cpus and boards. Get what is available for cheap with the needed pcie bandwidth open box on ebay from reputable sellers to save thousands of dollars.

Be sure to get a power supply that can handle all 4 cards. I run Silverstone Hela 2500s at about $800. Do not go cheap on power supplies. It will end in pain. Can confirm.

Then 2-3k for 64gb in DDR5 RDIMMs. This is the most painful thing to purchase but it is what it is.

Not only do I recommend this setup, I plan to build more of them to share with my team.

If you are patient and buy used, a 10k budget can get you a very powerful local AI rig running 100% FOSS software/drivers even today.