Serious question: why not run DGX Spark or Framework Desktop, at 30%-50% lower cost?
M5 Ultra has 4-5x the memory bandwidth of both. 1.2 TB/s memory bandwidth opens up good performance on relatively large models.
[dead]
alt Hacker News
M5 Ultra has 4-5x the memory bandwidth of both. 1.2 TB/s memory bandwidth opens up good performance on relatively large models.