alt Hacker NewsIf you were buying a computer today to use for DS4 (budget under 10k) what would you get? I care more about inference quality than speed. Or is it better to wait for the rumored M5 studio?
If you were buying a computer today to use for DS4 (budget under 10k) what would you get? I care more about inference quality than speed. Or is it better to wait for the rumored M5 studio?
For large contexts, you're probably going to want CUDA. The DGX Spark is expensive but would get you decent speeds on DS4 Flash. DS4 Pro is probably not possible with $10k if you want sub-10 minute prefill.