probably; 32-64 is the range where local models get extraordinarily useful, and in my experience any sub-4 quants get ridiculously incoherent, which is why those models tend to try to 'wow' people with tok/s rather than benchmarks.

haven't tried it yet though.

I’m wondering myself: Do bigger models suffer less from quantization? Are there papers?

you can get a lot done with models well under that - the google and qwen 20-30B class models are fantastic