alt Hacker NewsNo, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model.
MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something.
No, this is not a small model. I believe 4x Sparks is possible but 4.1 is pretty big for a flash model.
MiMo 2.6 Flash is the most capable model you can currently run on 2x Sparks without resorting to a quantised version of something.
I meant quantized. You can get an EXL3 quantized version thats almost the same performance.