I'm also hoping someone puts out a competitive 30-70B model soon. There's this massive dead zone between 24GB and <100GB of VRAM where it seems your best option is Qwen 3.8 27B.
There are many engines that alleviate this issue in particular. The current mood is running qwen flash next using strata, basalt, ect.
There are many engines that alleviate this issue in particular. The current mood is running qwen flash next using strata, basalt, ect.