How much VRAM do you need for that?
I squeeze Qwen3.5-122B-A10B at Q6 into 128GB. It's a great model.
alt Hacker News
I squeeze Qwen3.5-122B-A10B at Q6 into 128GB. It's a great model.