alt Hacker NewsWas “only” $2k in its previous form but even in this updated box the mem bandwidth is woefully inadequate. There’s a few models with space for a dedicated GPU for hybrid inference but imo not worth it. Save your money for a Xeon or EPYC build
Was “only” $2k in its previous form but even in this updated box the mem bandwidth is woefully inadequate. There’s a few models with space for a dedicated GPU for hybrid inference but imo not worth it. Save your money for a Xeon or EPYC build