logoalt Hacker News

linolevanyesterday at 9:48 PM1 replyview on HN

Tried it within LMStudio on my m4 macbook pro – it feels dramatically worse than gpt-oss-20b. Of the two (code) prompts I've tried so far, it started spitting out invalid code and got stuck in a repeating loop for both. It's possible that LMStudio quantizes the model in such a manner that it explodes, but so far not a great first impression.


Replies

tgtweakyesterday at 9:51 PM

Are you using the full BF16 model or a quantized mlx4?