alt Hacker NewsGreat news. Qwen 3.8 Flash Next (125B A6B) is coming out tomorrow. 4 or 6-bit should run nicely on 128GB.
Should bench better than Opus 4.7.
Great news. Qwen 3.8 Flash Next (125B A6B) is coming out tomorrow. 4 or 6-bit should run nicely on 128GB.
Should bench better than Opus 4.7.
I have had a difficult time with running 120b models on my 128gb setup, especially with any larger context size. The 6bit of Qwen 3.5 is already just over 100gb, and when you go down to 4bit it seems a bit lobotomized.