We actually deployed working speech to speech inference that builds on top of vLLM as the backbone. The main thing was to support the "Talker" module, which is currently not supported on the qwen3-omni branch for vLLM.

Check it out here: https://models.hathora.dev/model/qwen3-omni

That's unfortunate but not too surprising. This type of model is very new to the local hosting space.

Makes sense, I think streaming audio->audio inference is a relatively big lift.