logoalt Hacker News

jedbrooketoday at 3:21 PM1 replyview on HN

I hope the bonsai team makes another 1bit quant of this model (or releases code/instructions on how to do it), using the Qwen3.6 27B on my 16GB mac mini has been wild . The 1bit quant feels like opus level… for the first couple turns. Then it has trouble eg switching from plan mode to act mode. This is mostly mitigated by starting a new session. (tbf this limitation is called out on the hf page)

I saw unsloth has 1bit quants too so I might check that out, anybody have experience with those?


Replies

spwa4today at 4:24 PM

Sounds like you need to check what the max context is set to ...

show 1 reply