vLLM-Omni: Serving Qwen3-Omni with a Multi-Stage Pipeline for Multimodal Speech Generation

vLLM-Omni introduces a multi-stage serving pipeline for Qwen3-Omni, a multimodal model combining text, image, and audio understanding with speech generation. The system breaks inference into three stages: Thinker (multimodal reasoning), Talker (speech codec generation), and Code2