They've done considerable effort in making sure this model can run on basically every model runner, from Unsloth to MLX, https://dev.meta.ai/docs/muse-spark-open/deploy
Anyone who has tried a smaller/quantized version locally on apple silicon? Would love to know your experience, also tk/s on what hardware specs?
Yes, but still, what about users looking for NPU support. What happened to Microsoft's copilot+ PC campaign? (the NPU hardware, not the logo key and ad campaign) AMD's XDNA2 NPU is best supported by ONNX, I think Qualcomm Hexagon is too. The best consumer unified architectures are Apple, AMD ai+ and Qualcomm Snapdragon X Elite, even intel has an NPU offering.
As someone not in the loop, can you explain more of what you mean.