alt Hacker News"Muse Spark Open was optimized to run on Mac Studio with M5 Ultra, and together they’re the best way to run a powerful model on your own desktop."
Replies
ryanschaefer • today at 6:07 PM
Read it again. Two M5s.
Wait read that again. Two 512GB, unreleased model M5s.
This is gonna cost like 50k to run at home.
➕ show 3 replies
pitifulsurround • today at 6:04 PM
okay that's gonna be interesting to try
”Serve the model on either two Mac Studios, with M5 Ultra and 512GB of unified memory; or four Mac Studios with 256GB of unified memory, for a total of 1TB of unified memory, enough to hold a NVFP4 quantized version of Muse Spark Open”
Can not find any info on inference speed.