logoalt Hacker News

teaearlgraycold • today at 4:52 AM • 1 reply • view on HN

I'm also hoping someone puts out a competitive 30-70B model soon. There's this massive dead zone between 24GB and <100GB of VRAM where it seems your best option is Qwen 3.8 27B.


Replies

shockembopper • today at 4:58 AM

There are many engines that alleviate this issue in particular. The current mood is running qwen flash next using strata, basalt, ect.