Cant you run it on a pair of DGX spark? Sure it's expensive now, but at the initial retail price that was what, 8k in hardware? Not exactly unachievable
No, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model.
MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something.
No, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model.
MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something.