alt Hacker NewsOh, boy. This good tool hates my LM Studio... The following message appears when I run Bonsai in my LM Studio. I think my settings have done something wrong. ``` Failed to load the model Error loading model. (Exit code: null). Please check the settings and try loading the model again. ```
Replies
liuliu • today at 2:30 AM
It needs a mlx fork because the lowest bit in mlx is 2 currently (for affine quantization).
Same issue here, wanted to give it a shot but ran into that error trying to load the model in lm studio.