alt Hacker NewsFYI: nothing seems to be able to run this (easily) yet. llama.cpp, vllm etc I couldn't get working because of no support in the mainline version.
Replies
a_humean • today at 2:10 PM
Probably going to take a 1-3 days for support to land in llama.cpp and vllm.
They are giving pointers to how to run it now using for example https://recipes.vllm.ai/Qwen/Qwen3.8-Flash-Next (and an especially provided vllm release).