alt Hacker NewsThat's a quant 4 which the thread OP specifically called out as rubbish.
The Q4_K_XL bit for those not in the know.
Replies
greenavocado • today at 5:48 PM
I typically find myself using a context of between 150-500k with GPT models so local models are simply not enough and I stopped using them.
➕ show 2 replies
Anyone calling Qwen3.6-35B-A3B-Q4_K_XL “rubish” has no idea what they are talking about.