Qwen3.8-Omni: 迈向原生全模态智能体
摘要
Qwen3.8-Omni-Flash是一款原生多模态智能体模型,旨在提升真实世界生产力。它通过MoE架构和扩展上下文窗口增强了多模态理解与推理能力,并发布了多模态应用的开源框架。
arXiv:2609.25611v1 Announce Type: new
Abstract: We introduce Qwen3.8-Omni-Flash, a natively multimodal agentic model for real-world multimodal productivity. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3.8-Omni-Flash substantially improves multimodal understanding and reasoning, as well as performance on long-horizon agentic tasks. These capabilities are supported by a native multimodal co-training strategy that preserves strong text-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks. The model inherits the sparse mixture-of-experts (MoE) architecture of Qwen3.8-Next and extends the context window to one million tokens, supporting long-context multimodal reasoning and long-horizon planning. These advances enable integration into production workflows as a primary agent or a specialized sub-agent, supporting video editing, long-form audio and video translation, music-conditioned music video or movie generation, and video-based note or omni-skill creation. To address the lack of native audio and video support in existing agent harnesses, we release Qwen-MM-Plugins, a lightweight open-source plugin framework for multimodal productivity. We further frame real-time multimodal interaction as a system-level challenge requiring orchestration of context and memory management, tool use, and sub-agent delegation. Accordingly, we release Qwen-Live-Harness, an open-source framework for building responsive, real-time multimodal agents based on Qwen3.8-Omni-Flash. Extensive evaluations demonstrate that Qwen3.8-Omni-Flash achieves strong performance across multimodal understanding, reasoning, long-horizon agentic execution, and video productivity tasks. These results and the accompanying open-source tools support Qwen3.8-Omni-Flash as a practical foundation for deploying natively multimodal agents in research and production.
查看缓存全文
缓存时间: 2026/09/23 09:16
# Qwen3.8-Omni: Towards Native Omni-Modal Agents
Source: [https://arxiv.org/html/2609.25611](https://arxiv.org/html/2609.25611)
###### Abstract
We introduce Qwen3\.8\-Omni\-Flash, a natively multimodal agentic model designed for real\-world multimodal productivity\. Compared with previous omni models, which primarily emphasized perception and interaction, Qwen3\.8\-Omni\-Flash substantially improves multimodal understanding and reasoning, as well as performance on long\-horizon agentic tasks\. These capabilities are supported by a native multimodal co\-training strategy that preserves strong text\-domain capabilities while facilitating the transfer of agentic capabilities from text to audio and video tasks\. The model inherits the sparse mixture\-of\-experts \(MoE\) architecture of Qwen3\.8\-Next and extends the context window to one million tokens, supporting long\-context multimodal reasoning and long\-horizon planning\. Together, these advances enable integration into production workflows as either a primary agent or a specialized sub\-agent, supporting applications such as video editing, long\-form audio and video translation, music\-conditioned music video generation or movie generation, and video\-based note or omni\-skill creation\. To address the lack of native audio and video support in existing agent harnesses, we release the open\-source frameworkQwen\-MM\-Plugins111[https://github\.com/QwenLM/Qwen\-MM\-Plugins](https://github.com/QwenLM/Qwen-MM-Plugins), a lightweight plugin framework for multimodal productivity applications\. We further frame real\-time multimodal interaction as a system\-level challenge requiring orchestration of context and memory management, tool use, and sub\-agent delegation\. Accordingly, we releaseQwen\-Live\-Harness222[https://github\.com/QwenLM/Qwen\-Live\-Harness](https://github.com/QwenLM/Qwen-Live-Harness), an open\-source framework for building responsive, real\-time multimodal agents based on Qwen3\.8\-Omni\. Extensive evaluations demonstrate that Qwen3\.8\-Omni\-Flash achieves strong performance across multimodal understanding, reasoning, long\-horizon agentic execution, and video productivity tasks\. These results, together with the accompanying open\-source tools, support Qwen3\.8\-Omni\-Flash as a practical foundation for deploying natively multimodal agents in research and production settings\.

Figure 1:Qwen3\.8\-Omni\-Flash is a unified end\-to\-end model capable of processing multiple modalities, such as text, audio, image and video, and generating real\-time text or speech response\. Based on these features, Qwen3\.8\-Omni\-Flash supports a wide range of tasks, including but not limited to voice dialogue, video dialogue, and audio\-visual tool use\.## 1Introduction
Recent advances in reasoning models have made long\-horizon agentic tasks increasingly feasible, with test\-time computation emerging as a complementary axis of scaling\([OpenAI, 2024](https://arxiv.org/html/2609.25611#bib.bib28);[Anthropic, 2025](https://arxiv.org/html/2609.25611#bib.bib29);[DeepSeek\-AI, 2025](https://arxiv.org/html/2609.25611#bib.bib30);[Qwen Team, 2026d](https://arxiv.org/html/2609.25611#bib.bib31)\)\. However, most existing agentic systems focus on software development, text\-based knowledge work, graphical user interface interaction, or collaborative assistance, with multimodal capabilities used primarily for perception\. This emphasis leaves a gap in support for video\-centric, multimodal productivity workflows, such as agentic video editing, music video creation, and film production\. These workflows require not only multimodal perception but also global planning, temporal reasoning, and the evaluation of coherence and quality in generated multimodal content\. Moreover, long\-form audiovisual understanding itself can benefit from agentic capabilities, including selective memory, narrative tracking, and targeted review of relevant segments\. Motivated by these requirements and the limitations of existing systems, we investigate the potential of omni models to support agentic multimodal productivity\.
To this end, we present Qwen3\.8\-Omni\-Flash, Qwen’s latest native omnimodal MoE model, which supports reasoning over text, images, audio, and audiovisual content\. The model follows the architecture of Qwen3\.5\-Omni Thinker\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), with a sparse MoE language backbone\([Qwen Team, 2026a](https://arxiv.org/html/2609.25611#bib.bib32)\)and an upgraded AuT\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\)designed to better capture spatial cues in audio\. To develop the perceptual and reasoning capabilities required by multimodal productivity workflows, we first conduct native multimodal pretraining to strengthen unified perception and multimodal reasoning with long chains of thought\. We then build on this foundation through post\-training to enhance long\-context reasoning and inference\-time scaling\. The post\-training data and objectives emphasize long\-horizon problems across text, vision, and audiovisual settings, spanning general reasoning, coding, and agentic workflows\. To ground reasoning in environmental feedback, we complement static supervision with training in interactive environments, including executable code sandboxes and open harness\-based interfaces\. Finally, we apply multi\-teacher distillation to consolidate domain\-specialized and effort\-specialized policies into a unified model for agentic multimodal productivity\.
Our primary objective for this generation of omni models is to improve agentic productivity\. Achieving this objective requires addressing three key challenges: \(i\) video inputs incur substantial storage and transmission costs and require large token budgets, making long\-form processing expensive in agentic workflows; \(ii\) most existing harnesses lack support for streaming audio and video inputs within the main model context; and \(iii\) productivity\-oriented applications of omni models remain underexplored\.
To address the first challenge, we develop modules for information abstraction and on\-demand access to multimodal content\. Specifically,Omni\-CaptionandOmni\-Video2Noteconvert videos into detailed captions and structured textual summaries, respectively;Omni\-Memorysupports agentic lazy loading of audiovisual content; andOmni\-Skill\-Creatortransforms video tutorials or SOP\-style content into executable skills that can be invoked by agent harnesses\. Together, these modules reduce the need for dense processing of entire audiovisual inputs when abstracted information or selective retrieval suffices\. To address the second challenge, we integrate these modules intoQwen\-MM\-Plugins, which provides a lightweight interface through which existing agent harnesses can access audiovisual capabilities\. To address the third challenge, the plugin includes ready\-to\-use productivity modules, such asOmni\-Chatcut, supporting applications including long\-form audiovisual translation, film narration, and music video generation from audio tracks\. All components are released as open source inQwen\-MM\-Plugin, and Qwen3\.8\-Omni\-Flash can operate either as a native multimodal main agent or as a sub\-agent that invokes these tools\.
Critically, Qwen3\.8\-Omni\-Flash supports sequences of up to one million tokens while maintaining text capabilities comparable to those of similarly sized text\-only models and substantially improving omnimodal performance\. Compared with its predecessor, Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), it achieves an increase of more than 25% in the average score across 29 evaluations spanning audio reasoning, audiovisual reasoning, and audiovisual agent tasks\. Estimated API input costs per hour of audio and audiovisual content are reduced by more than 98% and 93%, respectively\.
## 2Model Design
### 2\.1Architecture
Qwen3\.8\-Omni\-Flash adopts the unified multimodal architecture, Thinker\-Talker architecture, of the Qwen\-Omni family\([Xu et al\., 2025a](https://arxiv.org/html/2609.25611#bib.bib10);[Xu et al\., 2025b](https://arxiv.org/html/2609.25611#bib.bib26);[Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\)\. Compared with Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), Qwen3\.8\-Omni\-Flash introduces several key improvements in scalability, alignment, and real\-time interaction:
- •The Thinker uses a hybrid sparse MoE language model to understand multimodal inputs and generate text for reasoning, dialogue, and tool use\.
- •A vision encoder, Spatial AuT encoder, and AuT encoder provide visual, spatial\-audio, and general\-audio representations, respectively\. Their outputs are projected into the Thinker’s shared representation space\.
- •Audio, spatial audio, and video representations include explicit timing information, helping the Thinker connect audio and visual events and reason about them across long input sequences\.
##### Backbone
The Thinker builds on the hybrid sparse MoE language backbone of Qwen3\.8\-Next\([Qwen Team, 2026a](https://arxiv.org/html/2609.25611#bib.bib32)\)\. Sparse expert activation increases model capacity while controlling the amount of feed\-forward computation used by each token\. For token mixing, the backbone combines Gated DeltaNet \(GDN\), which summarizes preceding context in a fixed\-size recurrent state, with interleaved attention layers that retain direct access to context tokens\.
The attention layers transition to Qwen Sparse Attention \(QSA\) through the warmup and sparse training stages\. QSA uses a lightweight indexer to score compressed micro\-block representations and select relevant context blocks, while core attention operates on the original tokens within the selected blocks\. The resulting backbone combines recurrent processing with selective token\-level retrieval over long multimodal sequences\. Pretraining uses a native context window of 256K tokens throughout, followed by an extension to 1M tokens after post\-training\.
##### Multimodal Encoder
The Thinker uses three perception encoders for visual, spatial\-audio, and general\-audio inputs\. The vision encoder, adopted from Qwen3\.8\-Next\([Qwen Team, 2026a](https://arxiv.org/html/2609.25611#bib.bib32)\), processes images and sampled video frames\.
Figure 2:Overview of the audio encoders in Qwen3\.8\-Omni\-Flash\. The general AuT encoder extracts contextual audio representations at 6\.25 Hz via convolutional downsampling and self\-attention\. A parallel Spatial AuT pathway processes multichannel spatial audio to capture directional and spatial cues\.For audio understanding, Qwen3\.8\-Omni\-Flash combines a general\-purpose AuT encoder for acoustic and linguistic content with a dedicated Spatial AuT encoder for spatial cues\. The general\-purpose AuT encoder\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\)uses a convolutional front end comprising four Conv2D blocks to downsample input acoustic features by a factor of 16, followed by temporal self\-attention layers that produce contextualized audio representations\. The encoder outputs tokens at 6,25 Hz, corresponding to approximately one token every 160 ms\. AuT is pretrained on a sizable audio corpus, using transcriptions generated by a dedicated Qwen ASR model\([Team, 2026](https://arxiv.org/html/2609.25611#bib.bib35)\)as supervision\. The pretraining corpus covers more than 20 languages, with Chinese, English, and other languages represented in a ratio of 3\.5:3\.5:3\. Dynamic attention\-window training supports both streaming inference with cached context and offline audio understanding\.
For spatial audio inputs, Spatial AuT provides a parallel processing pathway\. A spatial interface first represents multichannel audio in first\-order ambisonics \(FOA\) format\. Spatial AuT then processes the complex\-valued short\-time Fourier transform \(STFT\) of the FOA channels, retaining both real and imaginary components to preserve interchannel amplitude and phase relationships\. These relationships provide spatial cues associated with source direction, distance, and motion\. A convolutional front end, temporal self\-attention layers, and an output projection transform the spectral features into spatial audio representations\. Modality\-specific adapters project the outputs of both audio encoders and the vision encoder into the language backbone’s shared representation space, and all three encoders are aligned with the backbone during stage S1\.
### 2\.2Perception
The Thinker converts text, images, audio, spatial audio, and video into a unified token sequence\. Text is tokenized with the Qwen3\.8\-Next byte\-level byte\-pair encoding tokenizer, which uses a vocabulary of approximately 250K tokens\([Qwen Team, 2026a](https://arxiv.org/html/2609.25611#bib.bib32)\)\. Images and dynamically sampled video frames are processed by the vision encoder\. General audio, including audio extracted from video, is resampled to 16 kHz and converted into a 128\-channel mel\-spectrogram using a 25 ms window and a 10 ms hop before being encoded by AuT\. For multichannel audio, Spatial AuT produces a parallel spatial representation that complements the general audio representation from AuT\. The resulting visual, audio, and spatial\-audio representations are projected into the Thinker’s embedding space and arranged in temporal order for unified multimodal modeling\. We retain explicit textual timestamps to expose the source timeline directly to the language backbone\. The position IDs of spatial\-audio embeddings are arranged analogously to those of visual patches at different spatial locations within a video frame: embeddings associated with the same temporal slice share a temporal index while retaining distinct spatial position indices\. This layout preserves alignment with the audio stream while allowing the model to distinguish multiple spatial embeddings at each time step\.
## 3Pretraining
Qwen3\.8\-Omni\-Flash is pre\-trained on a diverse dataset that encompasses multiple languages and dialects as shown in Table[1](https://arxiv.org/html/2609.25611#S3.T1)and modalities, including image–text, video–text, audio–text, video–audio, video–audio–text, and pure\-text corpora\. Following Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), we employ a wider range of natural\-language prompts to enhance both the generalization ability and instruction\-following capabilities\. To achieve robust performance across all modalities, our training strategy incorporates both unimodal and cross\-modal data from the early pretraining stage\.
Table 1:Supported languages and dialects in Qwen3\.8\-Omni\-Flash\-Plus\.Modality\# VarietiesSupported languages and dialectsText201See Qwen3\.5 for the complete list of supported languages\.Speech Input11374 languages:Afrikaans, Arabic, Asturian, Azerbaijani, Basque, Belarusian, Bengali, Bosnian, Bulgarian, Cantonese, Catalan, Cebuano, Chinese, Croatian, Czech, Danish, Dutch, English, Esperanto, Estonian, Filipino, Finnish, French, Galician, Georgian, German, Greek, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Interlingua, Italian, Japanese, Javanese, Kannada, Kazakh, Korean, Kyrgyz, Lingala, Latvian, Lithuanian, Macedonian, Malay, Malayalam, Maltese, Maori, Marathi, Mongolian, Norwegian Bokmål, Norwegian Nynorsk, Oriya, Persian, Polish, Portuguese, Punjabi, Romanian, Russian, Serbian, Slovak, Slovenian, Spanish, Swahili, Swedish, Tajiki, Tamil, Telugu, Thai, Turkish, Ukrainian, Urdu, Uyghur, and Vietnamese\.39 Chinese dialects:Northeastern Mandarin, Guizhou dialect, Guangdong Cantonese, Henan dialect, Hong Kong Cantonese, Shanghainese, Shaanxi dialect, Tianjin dialect, Taiwanese Mandarin, Yunnan dialect, Anhui dialect, Fujian dialect, Gansu dialect, Guangdong Mandarin, Hubei dialect, Hunan dialect, Jiangxi dialect, Shandong dialect, Shanxi dialect, Sichuanese, Guangxi dialect, Hainan dialect, Chongqing dialect, Changsha dialect, Hangzhou dialect, Hefei dialect, Yinchuan dialect, Zhengzhou dialect, Shenyang dialect, Wenzhou dialect, Wuhan dialect, Kunming dialect, Taiyuan dialect, Nanchang dialect, Jinan dialect, Lanzhou dialect, Nanjing dialect, Hakka, and Southern Min\.Speech Output3629 languages:Chinese, English, German, Italian, Portuguese, Spanish, Japanese, Korean, French, Russian, Thai, Indonesian, Arabic, Vietnamese, Turkish, Finnish, Polish, Hindi, Dutch, Czech, Urdu, Tagalog, Swedish, Danish, Hebrew, Icelandic, Malay, Norwegian, and Persian\.7 Chinese dialects:Sichuanese, Beijing dialect, Tianjin dialect, Nanjing dialect, Shaanxi dialect, Cantonese, and Southern Min\.
We retain the temporal modeling strategy of Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), including its audio\-visual timestamp representation, without modification\. In this generation, spatial audio is introduced as an additional input modality\. Spatial AuT representations are temporally aligned with the existing audio and video representations, allowing spatial information to be incorporated into the unified multimodal sequence while preserving the established timestamp convention\.
The pre\-training of Qwen3\.8\-Omni\-Flash is structured into four distinct stages, all using a native sequence length of 262,144 tokens\. In the first stage, we freeze the language model parameters and focus on aligning the vision encoder, AuT, and Spatial AuT using image–text, monaural audio–text, and multichannel audio–text data\. In the second stage, we unfreeze all parameters and train with a wider range of multimodal data for more comprehensive learning\. In the third stage, we keep the backbone fixed and warm up the QSA indexer using supervision from dense attention\. In the final stage, we enable QSA and jointly optimize the backbone and indexer to adapt the model to sparse attention patterns:
1. \(1\)Encoder Alignment Stage \(S1\): During the initial pretraining phase, the LLM component of Qwen3\.8\-Omni\-Flash is initialized with parameters from Qwen3\.8\-Next\([Qwen Team, 2026a](https://arxiv.org/html/2609.25611#bib.bib32)\), while the vision encoder is adopted from Qwen3\.5 and the audio encoders are initialized with AuT and Spatial AuT\. The three encoders are trained separately on the fixed LLM, initially focusing on their respective adapters before training the encoders\.
2. \(2\)General Stage \(S2\): The second phase of pretraining utilizes a large\-scale dataset containing approximately 2\.5 trillion tokens, with the following distribution across modalities: text \(1\.1 trillion\), audio \(0\.7 trillion\), image \(0\.35 trillion\), video \(0\.15 trillion\), and video–audio \(0\.3 trillion\)\. The audio data include both monaural and multichannel audio\. All model parameters are unfrozen during this stage\. The introduction of more diverse multimodal data and tasks enhances the model’s understanding and interaction capabilities in auditory, spatial\-audio, visual, textual, and audio\-visual information\.
3. \(3\)QSA Warmup Stage \(S3\): In the third phase, we keep the pretrained backbone fixed and train the QSA indexer using the full\-attention distributions of the backbone as supervision\. Dense attention remains active during this stage, allowing the indexer to learn block\-level context selection before sparse attention is enabled\.
4. \(4\)QSA Stage \(S4\): In the final pretraining phase, we enable QSA in the corresponding attention layers and jointly train the backbone and indexer\. This stage allows the model to adapt to sparse attention patterns while retaining its multimodal understanding and long\-context capabilities\.
## 4Post\-Training
The post\-training of the Thinker follows a two\-stage pipeline comprising*Multi\-Teacher Distillation*and*Reinforcement Learning*\. The pipeline is designed to consolidate heterogeneous capabilities into a unified model while mitigating cross\-domain and cross\-modal interference, and to further improve response quality and interaction robustness through reinforcement learning\. The training data are serialized using the ChatML\([OpenAI, 2022](https://arxiv.org/html/2609.25611#bib.bib1)\)format and cover text\-only, visual, audio, and mixed\-modality conversations\.
- •Stage 1: Multi\-Teacher Distillation\.We first construct a collection of domain\-specialized teacher models, each initialized from the pre\-trained Qwen3\.8 base checkpoint and independently optimized through supervised fine\-tuning \(SFT\) and reinforcement learning \(RL\)\. The specialists cover a broad range of capabilities, including general instruction following, foundational reasoning, coding, agentic tasks, visual understanding, and audio understanding\. The specialist models are subsequently used to generate high\-quality domain\-specific training trajectories\. These trajectories are combined into a unified multimodal training mixture and distilled into a single student model\. This formulation allows each specialist to provide targeted supervision in its domain of expertise, while enabling the student to acquire these capabilities within a shared parameterization\. Compared with directly fine\-tuning the base model on a heterogeneous data mixture, specialist distillation provides stronger and more consistent supervision, reduces interference among modalities and task domains, and establishes a robust initial policy for the subsequent reinforcement\-learning stage\.
- •Stage 2: Reinforcement Learning\.Starting from the distilled checkpoint, we perform unified reinforcement learning across text, vision, audio, and mixed\-modality tasks\. Although multi\-teacher distillation equips the model with strong individual capabilities, the resulting policy may still exhibit uneven response quality across input modalities and suboptimal behavior in real\-world interactions\. In particular, audio\-conditioned queries remain more challenging than their text counterparts, while long conversations may expose issues such as unintended language switching, persona drift, and degradation in instruction following\. To address these limitations, the RL task mixture jointly covers reasoning, coding, agentic execution, multimodal understanding, audio\-conditioned dialogue, and multi\-turn interaction scenarios\. The reward signals evaluate both task\-level correctness and interaction quality\. In addition to rewarding accurate and helpful responses, the optimization encourages consistency across input modalities, natural responses to spoken queries, stable language and persona behavior, and reliable instruction following over extended conversational contexts\. For long\-horizon agentic tasks, rewards are determined by task outcomes and execution results rather than by the model’s self\-reported completion\. By jointly optimizing these objectives, the second stage transforms the collection of distilled specialist capabilities into a coherent policy\. The resulting Thinker maintains strong performance across heterogeneous domains while providing more consistent audio\-conditioned responses and more stable behavior in practical multi\-turn interactions\.
## 5Omni for Agentic Applications
### 5\.1Long Video Understanding
Qwen3\.8\-Omni\-Flash advances long\-context audiovisual understanding across a range of capabilities, including active audiovisual perception, meeting understanding and follow\-up task execution\. These advances extend beyond longer temporal coverage to more precise evidence localization, deeper understanding, and more efficient execution\.
##### Native Omni Agent for Long Video
Conventional static approaches to long\-video understanding feed all sampled frames and the accompanying audio in a single model invocation, even for videos lasting tens of minutes to several hours\. Increasing video duration leads to approximately linear growth in token consumption and greater difficulty in reasoning over the full input\. However, reasoning may require evidence from only a few minutes of the video\. With native agentic capabilities, Qwen3\.8\-Omni\-Flash plans its analysis based on the query and invokes tools to acquire relevant audio and visual evidence\. Following a coarse\-to\-fine strategy, the model retrieves video and audio segments on demand through iterative tool calls\. This enables more efficient use of the limited token budget\. Qwen3\.8\-Omni\-Flash can also parallelize audio and visual analysis by delegating tasks to multiple subagents as needed\. This enables efficient analysis of videos spanning several hours within the limited context window of the main agent\. By shifting long\-video understanding from static processing to on\-demand evidence gathering, native omni agent can improve accuracy while reducing token consumption\.
##### Meeting Minutes for Multispeaker
Multi\-participant meetings are among the most complex audio\-visual understanding scenarios: speakers take turns and overlap, while identities, references, and discussion topics continuously change\. Traditional cascaded meeting analysis systems suffer from long and complex pipelines; even from the perspective of multi\-speaker ASR alone, the sequential process of recognition, alignment, and diarization inevitably leads to severe error accumulation, further necessitating additional downstream models for content analysis\. Qwen3\.8\-Omni\-Flash jointly recognizes speakers across audio and video and natively supports up to one hour of audio\-visual input\. It can perform speaker segmentation, content transcription, and identity alignment end to end\. Given a complete meeting video and a request, the model can map participant relationships, generate meeting minutes, identify action items, and analyze project risks, using visual information to resolve references and entity ambiguity in the audio\. Combined with agents and tool use, it can also send emails, organize tasks, and even begin coding in response to meeting requirements, moving from understanding a meeting to acting on it\.
### 5\.2Content Creation
Qwen3\.8 Omni is taking audio\-visual agents into a new stage: from understanding sounds and images to independently planning, calling tools, and delivering finished videos, bringing omnimodal intelligence into professional audio\-visual content production workflows\.
##### Music\-to\-MV
We propose an agentic workflow for generating music videos from music tracks\. Built on Qwen3\.8\-Omni\-Flash andQwen\-MM\-Plugins, it offers a scalable solution for independent musicians and creators\. Creating visual content that complements a music track requires a comprehensive understanding of its lyrics, structure, and musical elements\. With its strong music\-understanding capabilities, Qwen3\.8\-Omni\-Flash can analyze an input song and produce time\-aligned lyric transcriptions, a global music caption, and localized descriptions of salient musical events organized along the song’s structural timeline\. This musical evidence provides creative grounding for the agent to develop a narrative script and design individual shots\. Qwen3\.8\-Omni\-Flash can also review the generated shots for visual quality and correspondence with the creative plan\. Together, Qwen3\.8\-Omni\-Flash andQwen\-MM\-Pluginsform an integrated workflow for end\-to\-end music\-to\-video production\.
##### Drama Translation
Traditional video translation typically involves multiple stages, including speech transcription, text translation, dubbing, audio mixing, and post\-production editing\. Coordinating these stages across different tools increases system complexity and makes it difficult to maintain consistency in character voices, dialogue duration, and visual pacing\. Built on Qwen3\.8\-Omni\-Flash andQwen\-MM\-Plugins, we develop an agentic workflow for short\-drama translation, providing developers with a reference for designing automated video localization systems\. Given a user request, the agent autonomously plans the localization process, selects and coordinates the required capabilities, and makes context\-aware decisions throughout execution\. It supports speaker\-aware dialogue recognition, conversational translation, character\-consistent voice cloning and dubbing, audio remixing, and quality assessment\. By integrating these capabilities through autonomous planning and orchestration, the workflow enables the automated delivery of localized short dramas for international audiences\.
##### Long\-Form Movie Commentary
For movies with runtimes of two to three hours, Qwen3\.8\-Omni\-Flash combines multimodal understanding with long\-horizon planning to generate commentary videos autonomously end\-to\-end\. The model analyzes narrative structure, key plot turning points, and character arcs across the full runtime, using this global context to guide commentary generation\. It further orchestrates synthesized narration, original film dialogue, on\-screen visuals, and background music into a coherent audiovisual composition, interleaving commentary with selected dialogue excerpts to preserve narrative coherence and emotional immersion\. By adapting narration pacing and audio levels to the scene context, the model enables smooth transitions among commentary, original audio, and music, maintaining a balanced audio mix throughout the resulting video\.
### 5\.3Video for Research, Learning, and Automation
Videos encode rich audiovisual information, yet relevant content is often dispersed across time, requiring repeated playback and manual navigation to locate and consolidate\. Building on its omnimodal understanding capabilities, Qwen3\.8\-Omni\-Flash transforms video content into structured knowledge artifacts, including interactive research reports, instructional notes, and reusable agent skills\. These artifacts consolidate essential information while preserving visual evidence and procedural context, making the underlying knowledge more accessible to both human users and AI agents\. This enables video content to support research, learning, and automated task execution\.
##### Omni\-Deep Research
Qwen3\.8\-Omni\-Flash supports video\-centric omni\-deep research, enabling in\-depth investigation grounded in both video content and external knowledge\. Given a video and a user query, the model analyzes the audiovisual content, identifies key research anchors such as claims, procedures, parameters, entities, and unresolved questions, and retrieves relevant information from web pages, documents, images, and other videos\. It then integrates and cross\-checks these multimodal sources with the original video, and organizes the results into an interactive HTML report that interleaves text with visual and video evidence and links research findings back to relevant moments in the source video\. This capability is particularly useful for understanding complex concepts, verifying claims, reproducing procedures, diagnosing practical problems, and supporting informed decisions\.
##### Video\-to\-Note
Built on the powerful omni\-modal understanding capabilities of Qwen3\.8\-Omni\-Flash, we developed Omni Video2Note, an agentic tool designed to help users extract information efficiently from large collections of tutorial videos, making it well suited for a wide range of instructional scenarios, including STEM education, everyday how\-to content, and medical or caregiving training\. By leveraging omni\-modal inputs, it can reconstruct the instructional flow of a video and surface the most important points\. For steps that benefit from visual context, it automatically selects the most informative frames from the source video\. It can also proactively adjust the crop region to improve visual clarity and readability\.
##### Skill Creator
Video demonstrations convey both procedural knowledge and domain\-specific expertise\. To translate this knowledge into executable agent capabilities, we introduce Omni Skill Creator, an open\-source component ofQwen\-MM\-Pluginsthat constructs reusable skills from omnimodal content\. The system extracts standard operating procedures \(SOPs\) from task demonstrations and distills tool usage, decision criteria, and key insights from expert instruction\. The resulting skills undergo verification and evaluation, enabling knowledge captured in a single demonstration to be transformed into a reusable and shareable capability for automated task execution\.
### 5\.4Omni\-Autoresearch
With Qwen3\.8\-Omni\-Flash, we explore autoresearch: using a native omni model’s multimodal understanding to drive model development autonomously\. We tasked it with improving Qwen2\.5\-Omni\-3B\([Xu et al\., 2025a](https://arxiv.org/html/2609.25611#bib.bib10)\)’s Sichuan dialect speech recognition within 12 hours and delivering a usable model—a practical test of automating the expertise\-intensive work needed to adapt smaller models for cost\-sensitive applications\. Qwen3\.8\-Omni\-Flash independently selected the WenetSpeech\-Chuan evaluation set, fixed the evaluation criteria, and established a baseline\. It then listened directly to audio samples, diagnosed recognition errors, and constructed targeted training data\. Across four rounds of experiments, it created 3,413 training examples and refined its approach using evaluation feedback, retaining effective changes and rolling back unsuccessful attempts\. The smaller model’s character error rate fell from 25\.79% to 15\.30% on the same evaluation set, a relative reduction of approximately 40\.7%\. This experiment demonstrates how native omni models can connect multimodal perception, experimental planning, and iterative training in an autonomous research workflow, helping smaller models acquire specialized capabilities for real\-world applications\.
## 6Evaluation
We organize the evaluation around the capabilities needed for native omni agents\. Section[6\.1](https://arxiv.org/html/2609.25611#S6.SS1)establishes the model’s general and modality\-specific capabilities, spanning text, vision, audio, and audio\-visual tasks\. These include perception and reasoning as well as coding, office work, and visual agent tasks\. Section[6\.2](https://arxiv.org/html/2609.25611#S6.SS2)then examines omni agentic capabilities through multimodal task execution and agentic audio\-visual evidence gathering\. Together, the evaluations assess the model’s capability profile, its progress over Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), and the effect of agentic execution on understanding accuracy and token consumption\.
##### Evaluation setup\.
For text and vision tasks, we compare against Qwen3\.8\-Flash\([Qiu et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib37)\), Qwen3\.8\-27B\([Qwen Team, 2026d](https://arxiv.org/html/2609.25611#bib.bib31)\), Qwen3\.7\-Plus\([Qwen Team, 2026c](https://arxiv.org/html/2609.25611#bib.bib36)\), and the additional baselines listed in the corresponding tables\. For audio and audio\-visual tasks, we include Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), Gemini 3\.8 Flash\([Google, 2026](https://arxiv.org/html/2609.25611#bib.bib38)\), Seed 2\.0 Lite\([Seed, 2026](https://arxiv.org/html/2609.25611#bib.bib39)\)333We use the API modeldoubao\-seed\-2\-0\-lite\-260428\., and Muse Spark 1\.2\([Meta, 2026](https://arxiv.org/html/2609.25611#bib.bib41)\)where results are available\. Benchmark\-specific harnesses and scoring conventions are described in the table notes\. Results involving tools reflect the model together with the stated execution setting\. The capability groups below describe task domains rather than a distinction between tool\-free and tool\-assisted inference\. We separately compare direct input interpretation with agentic evidence gathering in Section[6\.2\.2](https://arxiv.org/html/2609.25611#S6.SS2.SSS2)\. Bold values indicate the best result among the listed models for each metric, including ties; – denotes an unavailable or inapplicable result\.
### 6\.1General and Multimodal Capabilities
We first examine four complementary capability domains\. Text and visual evaluations cover both general reasoning and domain\-specific agent tasks, while audio and audio\-visual evaluations assess recognition, understanding, reasoning, and interaction through textual responses\.
#### 6\.1\.1Text Capabilities
We evaluate software engineering, repository\-level code generation, and office\-oriented agent tasks using DeepSWE 1\.1\([Datacurve, 2026](https://arxiv.org/html/2609.25611#bib.bib59)\), SWE\-bench Pro\([Deng et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib61)\), SWE\-bench Multilingual\([Khandpur et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib62)\), NL2Repo\-Bench\([Ding et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib60)\), and CoWorkBench\([Qiu et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib37)\)\. General text capabilities are assessed using IFBench\([Pyatkin et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib23)\), GPQA Diamond\([Rein et al\., 2023](https://arxiv.org/html/2609.25611#bib.bib3)\), HLE\([Phan et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib63)\), and LiveCodeBench v6\([Jain et al\., 2024](https://arxiv.org/html/2609.25611#bib.bib2)\), covering instruction following, scientific and multidisciplinary reasoning, and competitive coding\.
Table 2:Text capability evaluation of Qwen3\.8\-Omni\-Flash and baseline models\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-FlashQwen3\.8\-FlashQwen3\.8\-27BQwen3\.7\-PlusDeepSeek\-V4\-Flash\-0731Claude\-Opus\-4\.6 \(Max\)Coding and AgentDeepSWE 1\.157\.858\.742\.216\.554\.4–SWE\-bench Pro63\.362\.561\.755\.856\.053\.4SWE\-bench Multilingual80\.581\.073\.875\.8–77\.5NL2Repo\-Bench48\.948\.142\.341\.154\.247\.6CoWorkBench75\.373\.970\.765\.145\.168\.2General Text CapabilitiesIFBench81\.581\.379\.579\.179\.262\.5GPQA Diamond91\.091\.789\.290\.390\.891\.3HLE36\.535\.930\.834\.733\.840\.0LiveCodeBench v692\.691\.990\.389\.690\.688\.81DeepSWE 1\.1: evaluated with the Claude Code and mini\-SWE\-agent harnesses, temperature = 1\.0, top\_p = 0\.95, and a 256K context window\. We report the highest score across the two harnesses; notably, Qwen3\.8\-Flash performs best on mini\-SWE\-agent\.2SWE\-bench Pro: except for Claude\-Opus\-4\.6 \(Max\), for which we report the officially published score, all models are evaluated with the Claude Code harness, temperature = 1\.0, top\_p = 0\.95, and a 256K context window\. Problematic tasks were corrected, and all models evaluated with our harness were re\-evaluated on the refined benchmark\.3SWE\-bench Multilingual: evaluated with the mini\-SWE\-agent harness, temperature = 1\.0, top\_p = 0\.95, and a 256K context window\.4NL2Repo\-Bench: evaluated with the Claude Code harness\. To prevent reward hacking, we disable Bash commands that attempt to access the specific repository, such aspip download,pip install, andgit clone\.5CoWorkBench: an in\-house cowork benchmark for evaluating long\-horizon office and productivity agent tasks across computer science, finance, law, medical, and other productivity domains\.6HLE: judged by GPT\-4o\.
Table[2](https://arxiv.org/html/2609.25611#S6.T2)shows that Qwen3\.8\-Omni\-Flash retains competitive text performance relative to Qwen3\.8\-Flash\. It scores 63\.3 on SWE\-bench Pro, 48\.9 on NL2Repo\-Bench, and 75\.3 on CoWorkBench, compared with 62\.5, 48\.1, and 73\.9 for Qwen3\.8\-Flash\. On DeepSWE 1\.1 and SWE\-bench Multilingual, it scores 57\.8 and 80\.5, respectively, slightly below 58\.7 and 81\.0\. These results indicate that the model’s multimodal capabilities coexist with strong coding and agent execution capabilities\.
The same pattern extends to general text tasks: Qwen3\.8\-Omni\-Flash achieves 81\.5 on IFBench and 92\.6 on LiveCodeBench v6, the highest scores among the listed models, while obtaining 91\.0 on GPQA Diamond and 36\.5 on HLE\. Performance varies across tasks rather than improving uniformly; for example, Claude\-Opus\-4\.6 \(Max\) leads on HLE with 40\.0\.
#### 6\.1\.2Visual Capabilities
We assess visual agent capabilities with ClawEval\-MM\([Ye et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib64)\), AndroidWorld\([Rawles et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib65)\), and Vision2Web\([He et al\., 2026b](https://arxiv.org/html/2609.25611#bib.bib66)\)\. General visual evaluation covers embodied reasoning with ERQA\([Team, 2025](https://arxiv.org/html/2609.25611#bib.bib27)\), long\-video understanding with LVBench\([Wang et al\., 2024b](https://arxiv.org/html/2609.25611#bib.bib15)\), real\-world perception with RealWorldQA\([xAI, 2024](https://arxiv.org/html/2609.25611#bib.bib67)\), and mathematical and chart reasoning with MathVision\([Wang et al\., 2024a](https://arxiv.org/html/2609.25611#bib.bib4)\)and CharXiv \(RQ\)\([Wang et al\., 2024c](https://arxiv.org/html/2609.25611#bib.bib5)\)\. For the latter two benchmarks, we report both the default setting and the additional CI setting\.
Table 3:Visual capability evaluation of Qwen3\.8\-Omni\-Flash and baseline models\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-FlashQwen3\.8\-FlashQwen3\.8\-27BQwen3\.7\-PlusClaude\-Opus\-4\.6 \(Max\)Agentic Vision IntelligenceClawEval\-MM60\.4∣\\mid61\.964\.4∣\\mid60\.457\.4∣\\mid56\.957\.4∣\\mid60\.152\.5∣\\mid54\.7AndroidWorld87\.184\.581\.981\.062\.0Vision2Web62\.964\.062\.942\.1–General Vision CapabilitiesERQA71\.072\.365\.569\.840\.8LVBench76\.976\.672\.476\.263\.0RealWorldQA87\.788\.585\.986\.973\.9MathVision91\.890\.690\.090\.365\.5w/ CI96\.295\.794\.688\.4–CharXiv \(RQ\)83\.584\.683\.785\.866\.0w/ CI91\.490\.690\.285\.9–1ClawEval\-MM results are reported as Pass@3∣\\midAverage\. Pass@3 is the percentage of tasks passed in at least one of three trials; Average is the mean score across the three trials\.2Vision2Web: scores are averaged over the frontend, webpage, and website categories, using Claude Code and judged by gpt\-5\.4\-2026\-03\-05\.3MathVision and CharXiv \(RQ\): the first row reports results without CI, and the row labeled w/ CI reports results with CI\. A small number of incorrect MathVision ground\-truth annotations were manually corrected\. Our model uses a fixed prompt requesting step\-by\-step reasoning and a final answer in\\boxed\{\}\. For other models, we report the higher score from runs with and without this formatting instruction\.
As shown in Table[3](https://arxiv.org/html/2609.25611#S6.T3), Qwen3\.8\-Omni\-Flash achieves 87\.1 on AndroidWorld, exceeding Qwen3\.8\-Flash’s 84\.5\. On ClawEval\-MM, it obtains a higher average score \(61\.9 vs\. 60\.4\), but a lower Pass@3 \(60\.4 vs\. 64\.4\), illustrating the importance of distinguishing the two metrics\. Its Vision2Web score of 62\.9 is close to Qwen3\.8\-Flash’s 64\.0\.
For general visual capabilities, Qwen3\.8\-Omni\-Flash achieves 76\.9 on LVBench and 91\.8 on MathVision in the default setting, the best results among the listed models\. With CI, MathVision improves to 96\.2 and CharXiv \(RQ\) improves from 83\.5 to 91\.4\. Meanwhile, ERQA and RealWorldQA remain slightly below Qwen3\.8\-Flash\. Overall, the model combines competitive visual perception with strong performance on selected visual agent and tool\-assisted reasoning tasks\.
#### 6\.1\.3Audio Capabilities
Our audio evaluation covers multi\-speaker automatic speech recognition \(ASR\), general ASR, multilingual recognition, speech\-to\-text translation \(S2TT\), and instruction following, audio grounding and understanding, long\-audio reasoning, music understanding, and audio\-conditioned interaction\. Multi\-speaker ASR is assessed on AliMeeting Test\([Yu et al\., 2022](https://arxiv.org/html/2609.25611#bib.bib34)\), AISHELL\-4\([Fu et al\., 2021](https://arxiv.org/html/2609.25611#bib.bib71)\), MagicData\-RAMC\([Yang et al\., 2022](https://arxiv.org/html/2609.25611#bib.bib72)\), and MLC\-SLM \(en\)\([Mu et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib40)\), using DER and cpWER\. WenetSpeech\([Zhang et al\., 2022](https://arxiv.org/html/2609.25611#bib.bib25)\)complements these tasks with the Net and Meeting ASR subsets\. The multilingual evaluation includes FLEURS\-ASR and FLEURS\-S2TT\([Conneau et al\., 2022](https://arxiv.org/html/2609.25611#bib.bib6)\), covering the 60 languages listed in Table[4](https://arxiv.org/html/2609.25611#S6.T4), together with OmniLingua\-LongAudioASR, OmniLingua\-AudioMaxIfe, and OmniLingua\-MultiSpeaker from Omnilingua\-Bench\([Alibaba Token Hub, Alibaba Group, 2026](https://arxiv.org/html/2609.25611#bib.bib73)\), and MuLA\-Bench\([Yang et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib74)\)\. These additional benchmarks assess multilingual long\-form transcription, spoken instruction following, multi\-speaker transcription, and long\-form audio understanding, respectively\. We assess grounding with SpotSoundBench\([Sun et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib42)\), general audio understanding with MMAU\([Sakshi et al\., 2024](https://arxiv.org/html/2609.25611#bib.bib9)\), MMAR\([Ma et al\., 2025a](https://arxiv.org/html/2609.25611#bib.bib13)\), and MMSU\([Wang et al\., 2025a](https://arxiv.org/html/2609.25611#bib.bib14)\), and long\-audio reasoning with LongAudioSpan\([Huang et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib43)\), Vox\-Infinity\([Cheng et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib76)\)and LAMAR\-Bench\([Wang et al\., 2026a](https://arxiv.org/html/2609.25611#bib.bib48)\)\. We further use MuchoMusic\-RUL\([Zang et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib12)\), HumMusQA\([Weck et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib44)\), and MusTBench\([Kwon et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib45)\)for music understanding, and Audio MultiChallenge\([Gosai et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib46)\), WildSpeech\([Zhang et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib24)\), and VoiceBench\([Chen et al\., 2024](https://arxiv.org/html/2609.25611#bib.bib7)\)for audio\-conditioned interaction\. All results in this subsection concern textual outputs from audio inputs\.
Table 4:Audio capability evaluation of Qwen3\.8\-Omni\-Flash and baseline models\. The best scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-FlashQwen3\.5\-Omni\-PlusGemini 3\.8FlashSeed 2\.0 LiteMuse Spark 1\.2Multi\-Speaker ASR & ASRAliMeeting Test3\.4∣\\mid17\.288\.1∣\\mid89\.672\.6∣\\mid53\.175\.1∣\\mid76\.193\.7∣\\mid92\.7AISHELL\-42\.8∣\\mid11\.2100\.0∣\\mid100\.066\.4∣\\mid56\.964\.8∣\\mid64\.291\.3∣\\mid86\.0MagicData\-RAMC5\.7∣\\mid14\.198\.4∣\\mid97\.167\.9∣\\mid33\.843\.4∣\\mid35\.182\.1∣\\mid75\.3MLC\-SLM \(en\)4\.0∣\\mid14\.268\.6∣\\mid63\.960\.8∣\\mid26\.640\.4∣\\mid45\.574\.3∣\\mid52\.9WenetSpeech \(Net\)4\.83\.714\.24\.368\.2WenetSpeech \(Meeting\)4\.64\.816\.74\.742\.6MultilingualFLEURS\-ASR9\.37\.27\.932\.123\.6FLEURS\-S2TT31\.832\.233\.024\.828\.8OmniLingua\-LongAudioASR95\.56∣\\mid9\.2794\.07∣\\mid6\.8985\.19∣\\mid12\.8797\.78∣\\mid34\.0697\.78∣\\mid84\.41MuLA\-Bench72\.6061\.0073\.4358\.0634\.04OmniLingua\-AudioMaxIfe86\.5083\.1087\.9060\.7082\.20OmniLingua\-MultiSpeaker100\.00∣\\mid43\.2534\.97∣\\mid20\.1588\.33∣\\mid84\.4650\.73∣\\mid47\.6197\.00∣\\mid129\.0344\.58∣\\mid71\.0288\.67∣\\mid99\.2843\.44∣\\mid50\.4298\.67∣\\mid105\.8377\.19∣\\mid74\.05Audio GroundingSpotSoundBench67\.264\.239\.759\.616\.9Audio UnderstandingMMAU81\.881\.976\.977\.263\.5MMAR79\.879\.878\.577\.767\.3MMSU82\.183\.083\.380\.259\.9Long Audio ReasoningLongAudioSpan82\.7∣\\mid71\.8∣\\mid48\.274\.4∣\\mid49\.8∣\\mid45\.179\.3∣\\mid65\.5∣\\mid64\.6––Vox\-Infinity74\.7∣\\mid68\.3∣\\mid60\.856\.8∣\\mid64\.6∣\\mid58\.169\.2∣\\mid58\.4∣\\mid64\.269\.9∣\\mid69\.3∣\\mid59\.169\.3∣\\mid63\.9∣\\mid48\.1LAMAR\-Bench77\.8∣\\mid62\.2∣\\mid85\.364\.1∣\\mid21\.6∣\\mid54\.371\.1∣\\mid45\.5∣\\mid71\.243\.4∣\\mid9\.3∣\\mid58\.234\.1∣\\mid12\.1∣\\mid33\.4Music UnderstandingMuchoMusic\-RUL72\.671\.653\.761\.740\.1HumMusQA75\.875\.571\.266\.063\.3MusTBench50\.649\.140\.344\.029\.4Audio InteractionAudio MultiChallenge71\.557\.671\.963\.457\.9WildSpeech74\.375\.776\.474\.573\.4VoiceBench91\.692\.992\.384\.179\.81AliMeeting Test, AISHELL\-4, MagicData\-RAMC, and MLC\-SLM \(en\) results are reported as DER∣\\midcpWER \(lower is better for both metrics\)\. WenetSpeech and FLEURS\-ASR results are reported as WER \(lower is better\); FLEURS\-S2TT results are reported as BLEU \(higher is better\)\. For audio understanding, music, and interaction scores, higher is better\.2FLEURS: ASR and S2TT evaluation results both cover the following 60 languages: Chinese \(Mandarin\), English, Cantonese, Arabic, German, French, Spanish, Portuguese, Indonesian, Italian, Korean, Russian, Thai, Vietnamese, Japanese, Turkish, Hindi, Malay, Dutch, Urdu, Norwegian, Swedish, Danish, Hebrew, Finnish, Polish, Icelandic, Czech, Filipino, Persian, Greek, Afrikaans, Asturian, Belarusian, Bulgarian, Bengali, Bosnian, Catalan, Cebuano, Estonian, Galician, Gujarati, Croatian, Hungarian, Javanese, Kazakh, Kannada, Kyrgyz, Latvian, Macedonian, Malayalam, Marathi, Punjabi, Romanian, Slovak, Slovenian, Swahili, Tajik, Azerbaijani, and Ukrainian\.3OmniLingua\-LongAudioASR results are reported as success rate \(↑\\uparrow\)∣\\midWER \(↓\\downarrow\), both in percent\.4MuLA\-Bench and OmniLingua\-AudioMaxIfe: higher scores are better\.5OmniLingua\-MultiSpeaker: each cell reports success rate \(↑\\uparrow\)∣\\midtcpWER \(↓\\downarrow\) on the first line and cpWER \(↓\\downarrow\)∣\\midDER \(↓\\downarrow\) on the second line\. All four metrics are in percent; the best value for each metric among the listed models is shown in bold\.6LongAudioSpan results are reported as Accuracy∣\\midRubric∣\\midChain; the highest score for each metric is shown in bold\.7Vox\-Infinity results are reported as Ultra Multi\-Turn∣\\midPersonal Monologues∣\\midBeyond\-Semanti; the highest score for each metric is shown in bold\.8LAMAR\-bench results are reported as Track A∣\\midTrack B∣\\midTrack C; the highest score for each metric is shown in bold\.
##### Multi\-speaker recognition and audio understanding\.
The largest improvements over Qwen3\.5\-Omni\-Plus occur in multi\-speaker ASR\. On AliMeeting Test, DER and cpWER decrease from 88\.1 and 89\.6 to 3\.4 and 17\.2, respectively\. Qwen3\.8\-Omni\-Flash also achieves the lowest values for both metrics on AISHELL\-4, MagicData\-RAMC, and MLC\-SLM \(en\)\. In audio grounding, SpotSoundBench improves from 64\.2 to 67\.2\. On LongAudioSpan, Accuracy increases from 74\.4 to 82\.7 and Rubric from 49\.8 to 71\.8, although the Chain score of 48\.2 remains below Gemini 3\.8 Flash’s 64\.6\. The model also leads the listed baselines on MuchoMusic\-RUL, HumMusQA, and MusTBench, with scores of 72\.6, 75\.8, and 50\.6, respectively\.
##### Multilingual capabilities\.
The expanded multilingual evaluation reveals improvements in long\-form understanding, instruction following, and multi\-speaker transcription over Qwen3\.5\-Omni\-Plus\. On MuLA\-Bench, Qwen3\.8\-Omni\-Flash improves from 61\.00 to 72\.60, close to Gemini 3\.8 Flash’s 73\.43\. OmniLingua\-AudioMaxIfe increases from 83\.10 to 86\.50, compared with 87\.90 for Gemini 3\.8 Flash\. On OmniLingua\-MultiSpeaker, Qwen3\.8\-Omni\-Flash achieves a 100\.00% success rate and the lowest tcpWER, cpWER, and DER among the listed models, at 43\.25%, 34\.97%, and 20\.15%, respectively\. Recognition and translation remain more mixed\. On OmniLingua\-LongAudioASR, success rate improves from 94\.07% to 95\.56%, while WER increases from 6\.89% to 9\.27%\. FLEURS\-ASR likewise yields a higher error rate of 9\.3 than Qwen3\.5\-Omni\-Plus \(7\.2\) and Gemini 3\.8 Flash \(7\.9\), and FLEURS\-S2TT scores 31\.8 compared with 32\.2 and 33\.0\. These results distinguish gains in multilingual understanding and multi\-speaker processing from the remaining gaps in general transcription and translation\.
##### General ASR and interaction\.
Qwen3\.8\-Omni\-Flash obtains the lowest WenetSpeech \(Meeting\) error rate of 4\.6, while its WenetSpeech \(Net\) error rate of 4\.8 remains above Qwen3\.5\-Omni\-Plus’s 3\.7\. Audio MultiChallenge improves from 57\.6 to 71\.5 over the previous generation, whereas VoiceBench and WildSpeech remain below both Qwen3\.5\-Omni\-Plus and Gemini 3\.8 Flash\.
#### 6\.1\.4Audio\-Visual Capabilities
Table 5:Audio\-visual capability evaluation of Qwen3\.8\-Omni\-Flash and baseline models\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-FlashQwen3\.5\-Omni\-PlusGemini 3\.8FlashSeed 2\.0 LiteMuse Spark 1\.2Audio\-Visual UnderstandingDailyOmni85\.185\.184\.081\.479\.6WorldSense68\.563\.969\.667\.365\.0AVUT86\.685\.988\.081\.582\.4JoinAVBench75\.974\.170\.470\.671\.8AVSpeaker77\.271\.183\.975\.869\.9Audio\-Visual ReasoningOmniVideoBench63\.453\.865\.258\.562\.2Video\-MME\-v265\.047\.971\.064\.9–MMOU78\.868\.784\.567\.078\.8Long Audio\-Visual ReasoningLVOmniBench63\.353\.270\.7––Audio\-Visual CaptionOmniCloze63\.264\.260\.956\.365\.3OmniCap\-IF80\.6∣\\mid28\.272\.1∣\\mid14\.181\.9∣\\mid28\.374\.6∣\\mid18\.177\.9∣\\mid26\.8Audio\-Visual InteractionQIVD69\.665\.669\.162\.062\.0OmniVChat\-Bench89\.052\.165\.645\.269\.8Omni2Web56\.7∣\\mid51\.629\.6∣\\mid49\.157\.0∣\\mid50\.828\.3∣\\mid46\.535\.2∣\\mid27\.6ODUbench91\.64∣\\mid89\.5774\.69∣\\mid69\.6272\.06∣\\mid66\.3877\.28∣\\mid67\.8776\.87∣\\mid71\.28ProactiveVideoQA61\.535\.158\.068\.363\.6StreamingBench80\.857\.179\.977\.277\.8Audio\-Visual Spatial IntelligenceOmniEchoBench43\.923\.332\.028\.331\.31ODUbench results are reported as Audio∣\\midVA; the highest score for each setting is shown in bold\.2OmniCap\-IF results are reported as CSR∣\\midISR; the highest score for each metric is shown in bold\.3Omni2Web results are reported as Track A∣\\midTrack B; the highest score for each track is shown in bold\.
We evaluate joint audio\-visual understanding, reasoning, captioning, and interaction using the benchmarks in Table[5](https://arxiv.org/html/2609.25611#S6.T5)\. The suite includes DailyOmni\([Zhou et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib16)\), WorldSense\([Hong et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib17)\), AVUT\([Yang et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib20)\), AVSpeaker\([Nguyen et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib19)\), JoinAVBench\([Chao et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib47)\); OmniVideoBench\([Li et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib52)\), Video\-MME\-v2\([Fu et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib53)\), MMOU\([Goel et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib54)\), and LVOmniBench\([Tao et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib55)\)for reasoning over video; OmniCloze\([Ma et al\., 2025b](https://arxiv.org/html/2609.25611#bib.bib22)\)and OmniCap\-IF\([Wang et al\., 2026b](https://arxiv.org/html/2609.25611#bib.bib56)\)for captioning; and QIVD\([Pourreza et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib21)\), ODUbench\([Chen et al\., 2026a](https://arxiv.org/html/2609.25611#bib.bib49)\), ProactiveVideoQA\([Wang et al\., 2025b](https://arxiv.org/html/2609.25611#bib.bib57)\), StreamingBench\([Lin et al\., 2024](https://arxiv.org/html/2609.25611#bib.bib58)\), OmniVChat\-Bench\([He et al\., 2026a](https://arxiv.org/html/2609.25611#bib.bib50)\), and Omni2Web\([Han et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib75)\)for interaction; OmniEchoBench\([Liu et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib51)\)for audiovisual spatial intelligence\. The video\-reasoning results provide the reference setting for the agentic comparison in Section[6\.2\.2](https://arxiv.org/html/2609.25611#S6.SS2.SSS2)\.
Compared with Qwen3\.5\-Omni\-Plus, Qwen3\.8\-Omni\-Flash improves on OmniVideoBench from 53\.8 to 63\.4, Video\-MME\-v2 from 47\.9 to 65\.0, and LVOmniBench from 53\.2 to 63\.3\. These results show stronger joint audio\-visual performance across the evaluated tasks\. Gemini 3\.8 Flash nevertheless retains higher scores on the three video\-reasoning benchmarks above, motivating the investigation of agentic inference rather than relying solely on direct input interpretation\. Captioning and interaction also show substantial, though task\-dependent, gains\. On OmniCap\-IF, CSR and ISR increase from 72\.1 and 14\.1 to 80\.6 and 28\.2, approaching Gemini 3\.8 Flash’s 81\.9 and 28\.3\. StreamingBench improves from 57\.1 to 80\.8, and ProactiveVideoQA from 35\.1 to 61\.5\. Qwen3\.8\-Omni\-Flash achieves the highest listed QIVD score of 69\.6 and ties the previous generation on OmniVChat\-Bench at 89\.0\. On Omni2Web, it scores 56\.7 on Track A and 51\.6 on Track B, compared with 29\.6 and 49\.1 previously\. It also improves on both ODUbench settings significantly\. In contrast, Seed 2\.0 Lite remains ahead on ProactiveVideoQA\. Beyond these tasks, we extend Qwen3\.8\-Omni\-Flash with omni\-spatial intelligence, with its OmniEchoBench score increasing from 23\.3 to 41\.7\.
### 6\.2Omni Agentic Capabilities
Building on these capability\-specific evaluations, we focus on agent workflows that combine multimodal evidence with task\-directed execution\. We first evaluate multimodal tool use and web\-search tasks, and then study whether an agent can improve audio\-visual understanding by actively locating and verifying evidence\. This section complements the text and visual agent tasks above by focusing on omni task execution and agentic perception\.
#### 6\.2\.1Multimodal Agent Benchmarks
WildClawBench\-MM\([Ding et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib68)\), UniClawBench\([Chen et al\., 2026b](https://arxiv.org/html/2609.25611#bib.bib69)\), and AgenticVBench\([Cao et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib70)\)assess multimodal tool use, while OmniGAIA\([Li et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib18)\)assesses tasks involving web search\. WildClawBench\-MM is restricted to WildClawBench tasks that involve images, video, or audio\. WildClawBench\-MM and AgenticVBench use Claude Code, UniClawBench uses OpenClaw, and OmniGAIA is evaluated without an external agent harness\. These are distinct execution settings rather than a single shared harness\.
Table 6:Omni agentic performance of Qwen3\.8\-Omni\-Flash and baseline models\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-FlashQwen3\.5\-Omni\-PlusGemini 3\.8FlashSeed 2\.0 LiteWildClawBench\-MM71\.034\.558\.941\.9UniClawBench69\.667\.169\.061\.2AgenticVBench36\.814\.545\.010\.0OmniGAIA74\.057\.278\.664\.41WildClawBench\-MM: evaluated with Claude Code on the subset of WildClawBench tasks involving images, video, or audio\.2UniClawBench: evaluated with OpenClaw\.3AgenticVBench: evaluated with Claude Code\.4OmniGAIA: evaluated without an external agent harness\.
Table[6](https://arxiv.org/html/2609.25611#S6.T6)shows improvements over Qwen3\.5\-Omni\-Plus on all four benchmarks\. WildClawBench\-MM increases from 34\.5 to 71\.0, AgenticVBench from 14\.5 to 36\.8, and OmniGAIA from 57\.2 to 74\.0, corresponding to gains of 36\.5, 22\.3, and 16\.8 points\. UniClawBench improves from 67\.1 to 69\.6\. Qwen3\.8\-Omni\-Flash leads the listed models on WildClawBench\-MM and UniClawBench; Gemini 3\.8 Flash leads on AgenticVBench and OmniGAIA with 45\.0 and 78\.6\. The comparison demonstrates stronger multimodal agent execution than the previous generation while identifying remaining gaps relative to other models\.
#### 6\.2\.2Agentic Omni Understanding
Long audio\-visual inputs often distribute relevant evidence across multiple segments\. We compare two settings on OmniVideoBench, Video\-MME\-v2, and LVOmniBench:Static, in which the model directly interprets the input, andQwen Code, in which an agent plans its approach, invokes tools, and iteratively locates and verifies relevant evidence\. We apply both settings to Qwen3\.8\-Omni\-Flash and Gemini 3\.8 Flash to examine how agentic execution changes each model’s performance\.
Table 7:Agentic omni understanding performance under Static and Qwen Code settings\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-Flash\(Static\)Qwen3\.8\-Omni\-Flash\(Qwen Code\)Gemini 3\.8 Flash\(Static\)Gemini 3\.8 Flash\(Qwen Code\)OmniVideoBench63\.467\.865\.270\.1Video\-MME\-v265\.071\.371\.072\.7LVOmniBench63\.373\.670\.770\.71Static denotes direct interpretation of the input\. Qwen Code denotes an agentic setting in which the model uses Qwen Code to plan its approach, call tools, and progressively locate and verify evidence\.
Table[7](https://arxiv.org/html/2609.25611#S6.T7)shows that Qwen3\.8\-Omni\-Flash benefits from agentic execution on all three benchmarks: OmniVideoBench improves from 63\.4 to 67\.8, Video\-MME\-v2 from 65\.0 to 71\.3, and LVOmniBench from 63\.3 to 73\.6\. The largest gain is on LVOmniBench, where the model moves from 7\.4 points below Gemini 3\.8 Flash in the Static setting to 2\.9 points above it in the Qwen Code setting\. Gemini 3\.8 Flash also benefits on OmniVideoBench and Video\-MME\-v2, and retains the highest agentic scores on those two tasks\. Thus, the benefit of agentic evidence gathering depends on both the model and the task\.
##### Token efficiency\.
On OmniVideoBench, agentic understanding improves accuracy while reducing reported token consumption per query from 145,736 to 79,117, a reduction of approximately 45\.7% \(Table[8](https://arxiv.org/html/2609.25611#S6.T8)\)\. The agentic mode preserves context across turns\. This result shows an improved accuracy–token trade\-off in the evaluated setting; it does not establish a corresponding reduction in end\-to\-end latency or monetary cost\.
Table 8:Accuracy and token consumption of Qwen3\.8\-Omni\-Flash on OmniVideoBench under Static and agentic understanding settings\.MetricStaticQwen CodeAccuracy \(↑\\uparrow\)63\.467\.8Tokens per query \(↓\\downarrow\)145,73679,1171Agentic understanding preserves context across turns\.
## 7Realtime Interaction
Realtime omni\-modal interaction requires a careful balance between responsiveness, speech naturalness, and agentic functionality\. To address these challenges, we enhance the Talker module to generate more expressive and realistic spoken responses under stringent latency constraints, design an efficient inference pipeline to support low\-latency realtime generation, and developQwen\-Live\-Harnessto extend Qwen3\.8\-Omni\-Flash\-Realtime to practical live interaction scenarios with asynchronous tool use, proactive interaction, and persistent memory\. Together, as shown in Figure[3](https://arxiv.org/html/2609.25611#S7.F3), these components form a unified framework for realtime omni\-modal applications\.
Figure 3:The overview of Qwen3\.8\-Omni\-Flash\-Realtime and Qwen\-Live\-Harness\. Qwen3\.8\-Omni\-Flash\-Realtime adopts the Thinker\-Talker architecture\. Thinker is tasked with text generation while Talker focuses on generating streaming speech tokens by receives high\-level representations directly from Thinker\. To achieve ultra–low\-latency streaming, Talker autoregressively predicts a multi\-codebook sequence\. At each decoding step, an MTP module outputs the residual codebooks for the current frame, after which the Code2Wav renderer incrementally synthesizes the corresponding waveform, enabling frame\-by\-frame streaming generation\.### 7\.1Talker
Inherited from Qwen3\.5\-Omni\-Plus\([Qwen Team, 2026b](https://arxiv.org/html/2609.25611#bib.bib33)\), Talker operates on Residual Vector Quantization \(RVQ\) tokens and employs a Multi\-Token Prediction \(MTP\) module to model residual codebooks, ensuring precise control over acoustic details\. In addition, we design a dedicated system prompt to specify target voice characteristics and incorporate ARIA for streaming speech generation\. Furthermore, an upsampling pathway is integrated into the causal Code2Wav decoder, elevating waveform reconstruction from 24 kHz to 48 kHz and substantially improving high\-frequency fidelity\.
We employ a five\-stage training pipeline to enable Talker to adapt to the rich contextual representations from Thinker and generate natural spoken responses\. In the initial pre\-training stage, a dedicated data pipeline is established to build a comprehensive, balanced dataset\. During continual pre\-training \(CPT\), complex conversational context corpora are introduced to bolster Talker’s contextual modeling capability\. Following CPT, we train individual language experts and utilize Multi\-Teacher On\-Policy Distillation \(MOPD\)\([Ma et al\., 2026](https://arxiv.org/html/2609.25611#bib.bib8)\)for multilingual speech generation, which effectively mitigates foreign accent artifacts induced by monolingual corpora\. Subsequently, a lightweight speaker fine\-tuning stage is conducted to capture target speaker characteristics\. Finally, in the reinforcement learning stage, we fine\-tune Thinker to align with human preferences and optimize Talker via GSPO\([Zheng et al\., 2025](https://arxiv.org/html/2609.25611#bib.bib11)\)using reward signals from the aligned Thinker, further elevating overall performance\.
### 7\.2Efficiency
To support low\-latency inference, Qwen3\.8\-Omni\-Flash\-Realtime combines chunk\-wise streaming input processing in Thinker with incremental speech generation in Talker\. Talker consumes streamed Thinker outputs and uses ARIA to adaptively align and interleave text and speech tokens, enabling speech continuation from partial text prefixes\. At each acoustic frame, a multi\-token prediction \(MTP\) module predicts the residual RVQ codebooks, followed by a causal Code2Wav decoder that incrementally reconstructs the waveform\. Together, these mechanisms allow text generation, speech\-token prediction, and waveform reconstruction to proceed progressively, enabling audio delivery before the complete response has been generated\.
Table 9:Realtime API efficiency of Qwen3\.8\-Omni\-Flash\-Realtime\.InputDuration \(s\)Text TPSTTFT \(ms\)TTFC \(ms\)Generation RTFAudio684\.87591\.26978\.360\.1538Audio1283\.18604\.80982\.740\.1537Audio2081\.06617\.981026\.390\.1538Audio\-Video684\.89837\.961214\.730\.1524Audio\-Video1284\.33911\.851268\.070\.1527Audio\-Video2083\.00981\.011350\.490\.1528We evaluate the realtime API of Qwen3\.8\-Omni\-Flash\-Realtime using 6\-, 12\-, and 20\-second audio\-only and audio\-video excerpts\. Audio is transmitted as 16 kHz mono PCM, with audio\-video inputs additionally containing1280×7201280\\times 720frames at 1 FPS\. Each condition includes ten valid responses after one warm\-up request, using fresh sessions and a fixed instruction requiring more than 200 output text tokens\. Inputs are uploaded before explicit turn submission, with voice activity detection disabled\.
Time\-to\-first\-text \(TTFT\) and time\-to\-first\-audio\-chunk \(TTFC\) are measured from client\-side input commitment to the first nonempty output text and audio chunks, respectively\. They include network transit and server\-side processing but exclude connection establishment, input upload, and playback\. Text TPS measures streaming text throughput using server\-reported token counts\. Audio generation real\-time factor \(RTF\) is the interval between the first and last audio chunks divided by the generated waveform duration\. Both generation metrics exclude the initial response waiting time\.
As shown in Table[9](https://arxiv.org/html/2609.25611#S7.T9), text throughput remains within 81\.06–84\.89 tokens per second\. Reported first\-audio latencies are approximately 0\.98–1\.03 seconds for audio\-only inputs and 1\.21–1\.35 seconds for audio\-video inputs\. Visual input increases startup latency while sustained generation efficiency remains similar\. Generation RTF stays near 0\.153, corresponding to approximately6\.5×6\.5\\timesrealtime generation speed under the evaluated setting\.
### 7\.3Harness for Realtime Application
To connect realtime multimodal interaction with practical agentic workflows, we developQwen\-Live\-Harness\. The framework connects Qwen3\.8\-Omni\-Flash\-Realtime to desktop audio\-visual inputs and external agent backends, combining low\-latency conversation with asynchronous execution, proactive interaction, and persistent memory\.
##### Asynchronous tool use and sub\-agent delegation\.
The foreground agent delegates tasks to external backends, including Qwen Code, Codex, and Claude Code, through a unified adapter interface\. Task submission returns an immediate acknowledgment, allowing the conversation to continue while backend execution proceeds independently\. Progress and results are incorporated into the conversational context asynchronously, with concise spoken notifications delivered around ongoing speech and playback\. Users can interrupt the current spoken response without cancelling delegated work, and backend tasks can continue after the realtime call ends\.
##### Proactive interaction\.
The harness supports user\-defined conditions over audio, visual input, and time\. Perceptual monitoring tasks run in independent realtime sessions and produce textual event reports, which the foreground agent converts into spoken notifications when the conversation permits\. Cooldowns and suppression of consecutive positive detections limit redundant notifications\. This design supports screen monitoring, environmental observation, and scheduled reminders during live sessions\.
##### Persistent memory\.
The harness combines recorded dialogue, explicit working memory, and selected user facts retained across conversations\. Reusable information is consolidated into persistent profiles and retrieved through lexical search with optional embedding\-based matching\. When enabled, visual memory stores textual observations derived from captured frames\. These mechanisms preserve relevant preferences and context across realtime sessions, supporting continuity in both conversation and task delegation\.
### 7\.4Performance
We evaluate Qwen3\.8\-Omni\-Flash\-Realtime against Qwen3\.5\-Omni\-Plus, Gemini 3\.8 Flash, Seed 2\.0 Lite, and Muse Spark 1\.2 on several representative omni\-modal interaction benchmarks\. As shown in Table[10](https://arxiv.org/html/2609.25611#S7.T10), the model delivers strong interaction performance, despite operating in a non\-thinking mode to prioritize responsiveness\.
Table 10:Multimodal interaction performance comparison of Qwen3\.8\-Omni\-Flash\-Realtime and baseline models\. The highest scores are shown in bold\.BenchmarkQwen3\.8\-Omni\-Flash\-RealtimeQwen3\.5\-Omni\-PlusGemini 3\.8FlashSeed 2\.0 LiteMuse Spark 1\.2Audio\-Visual InteractionQIVD66\.865\.669\.162\.062\.0ProactiveVideoQA58\.135\.158\.068\.363\.6StreamingBench78\.957\.179\.977\.277\.8OmniVChat\-Bench82\.352\.165\.645\.269\.8Omni2Web45\.1∣\\mid57\.029\.6∣\\mid49\.157\.0∣\\mid50\.828\.3∣\\mid46\.535\.2∣\\mid27\.6ODUbench90\.2∣\\mid86\.274\.7∣\\mid69\.672\.1∣\\mid66\.477\.3∣\\mid67\.976\.9∣\\mid71\.3Audio InteractionWildSpeech72\.575\.776\.474\.573\.4VoiceBench88\.892\.992\.384\.179\.81ODUbench results are reported as Audio∣\\midVA; the highest score for each setting is shown in bold\.2Omni2Web results are reported as Track A∣\\midTrack B; the highest score for each setting is shown in bold\.
In particular, it achieves substantial gains over Gemini 3\.8 Flash on OmniVChat\-Bench, ODUbench, and Omni2Web \(Track B\)\. On OmniVChat\-Bench, which evaluates conversational ability in everyday interaction scenarios, the model obtains 82\.3, significantly outperforming 65\.6 from Gemini 3\.8 Flash\. This result highlights its strong omni\-modal dialogue capability in practical user\-facing settings\. On ODUbench, which evaluates the understanding of user intent across omni\-modal inputs, the model obtains the best listed scores in both the audio and audio\-visual settings, demonstrating that it can accurately capture user intention even under realtime constraints\. Meanwhile, Omni2Web \(Track B\) evaluates the understanding of GUI\-based interactions, and the strong result indicates that Qwen3\.8\-Omni\-Flash\-Realtime can serve as a capable agent for GUI interaction, a key requirement of Qwen\-Live\-Harness\. Overall, these results demonstrate that the model preserves strong interaction quality while maintaining realtime responsiveness, making it well suited for practical live agentic applications\.
Table 11:Voice cloning capability comparison\. Benchmarks marked with∗are in\-house\.BenchmarkQwen3\.8\-Omni\-Flash\-RealtimeQwen3\.5\-Omni\-PlusSeedAudioMiniMax\-Speech\-2\.8Content StabilitySEEDzh∣\\miden∣\\midhard0\.74∣\\mid0\.89∣\\mid5\.290\.99∣\\mid1\.26∣\\mid6\.371\.76∣\\mid1\.02∣\\mid7\.700\.82∣\\mid0\.99∣\\mid9\.08Multilingual Voice Cloning30 lang3\.173\.4819\.776\.05Cross\-Lingual Voice Cloning12 cl\-lang3\.633\.747\.8010\.59Accented Voice Cloning∗Chinese dialects5\.035\.397\.587\.48SpeechSuperClue∗ml∣\\midcl3\.34∣\\mid4\.006\.23∣\\mid8\.084\.99∣\\mid11\.553\.95∣\\mid4\.83SwanBench\-Speechzh∣\\miden1\.96∣\\mid2\.371\.76∣\\mid2\.861\.59∣\\mid3\.461\.57∣\\mid3\.57LongSpeechGeneration∗zh∣\\miden1\.74∣\\mid1\.5919\.25∣\\mid4\.527\.71∣\\mid5\.097\.11∣\\mid6\.51Timbre ConsistencySEEDzh∣\\miden∣\\midhard0\.805∣\\mid0\.760∣\\mid0\.7870\.741∣\\mid0\.706∣\\mid0\.7160\.796∣\\mid0\.751∣\\mid0\.7760\.777∣\\mid0\.692∣\\mid0\.754Multilingual Voice Cloning30 lang0\.8450\.7890\.8400\.792Cross\-Lingual Voice Cloning12 cl\-lang0\.7090\.5240\.6990\.657Accented Voice Cloning∗Chinese dialects0\.7110\.6410\.6960\.666SpeechSuperClue∗ml∣\\midcl0\.763∣\\mid0\.6740\.670∣\\mid0\.5700\.747∣\\mid0\.6470\.714∣\\mid0\.571SwanBench\-Speechzh∣\\miden0\.828∣\\mid0\.7950\.768∣\\mid0\.7280\.799∣\\mid0\.7520\.804∣\\mid0\.763LongSpeechGeneration∗zh∣\\miden0\.820∣\\mid0\.7680\.597∣\\mid0\.4700\.811∣\\mid0\.7390\.811∣\\mid0\.764Overall Cloning ScoreSpeechSuperClue∗ml∣\\midcl3\.749∣\\mid3\.3063\.253∣\\mid2\.8353\.448∣\\mid2\.7563\.589∣\\mid3\.0211Content stability is measured by WER/CER \(lower is better\)\.2timbre consistency is measured by speaker similarity \(higher is better\)\.3Multiple values are separated by∣\\mid, in the order of the subset shown under each benchmark\.
To evaluate real\-time speech response capabilities, we benchmark Qwen3\.8\-Omni\-Flash\-Realtime against leading industry baselines, including SeedAudio, MiniMax\-Speech\-2\.8, Gemini 3\.1 TTS Flash, SeedTTS 2\.0, and ElevenLabs V3, across both public and in\-house evaluation suites\. As detailed in Table[11](https://arxiv.org/html/2609.25611#S7.T11)and Table[12](https://arxiv.org/html/2609.25611#S7.T12), Qwen3\.8\-Omni\-Flash\-Realtime demonstrates superior content stability, timbre consistency, controllability, and naturalness\.Voice Cloning\. In zero\-shot voice cloning \(Table[11](https://arxiv.org/html/2609.25611#S7.T11)\), Qwen3\.8\-Omni\-Flash\-Realtime consistently achieves the best content stability \(lowest WER/CER\) and highest timbre similarity across the SEED, multilingual, cross\-lingual, and accented speech benchmarks\. Notably, for long\-horizon generation, it substantially mitigates degradation, maintaining robust stability on both SwanBench\-Speech and LongSpeechGeneration\. In challenging in\-the\-wild evaluations \(SpeechSuperClue\), Qwen3\.8\-Omni\-Flash\-Realtime achieves overall cloning scores of 3\.749 \(multilingual\) and 3\.306 \(cross\-lingual\), outperforming SeedAudio and MiniMax\-Speech\-2\.8 by a clear margin\.Custom Voice\. As shown in Table[12](https://arxiv.org/html/2609.25611#S7.T12), Qwen3\.8\-Omni\-Flash\-Realtime maintains leading content stability, excelling in phonetic precision \(93\.3% accuracy on PhonePronunciation\) and ultra\-long speech generation \(1\.83 WER and 0\.693 similarity\)\. For stylistic controllability, Qwen3\.8\-Omni\-Flash\-Realtime attains a 95\.0% success rate, closely matching Gemini 3\.1 TTS Flash \(97\.5%\)\. Furthermore, in speech naturalness arena, Qwen3\.8\-Omni\-Flash\-Realtime achieves a competitive 72\.7% win rate, approaching Gemini 3\.1 TTS Flash \(74\.2%\) while significantly outperforming MiniMax 2\.8 HD \(48\.0%\), SeedTTS 2\.0 \(66\.2%\), and ElevenLabs V3 \(23\.1%\)\.
Table 12:Comprehensive Custom\-Voice capability comparison\. Benchmarks marked with∗are in\-house\.BenchmarkQwen3\.8\-Omni\-Flash\-RealtimeQwen3\.5\-Omni\-PlusGemini 3\.1TTS FlashMinimax2\.8 HDSeedTTS2\.0ElevenLabsV3Content StabilitySEEDzh∣\\miden∣\\midhard0\.83∣\\mid0\.93∣\\mid5\.221\.12∣\\mid2\.54∣\\mid7\.302\.41∣\\mid1\.48∣\\mid19\.461\.10∣\\mid1\.69∣\\mid6\.820\.87∣\\mid1\.41∣\\mid6\.871\.62∣\\mid0\.95∣\\mid12\.51Multilingual test set29 lang3\.165\.945\.9016\.31–6\.86SpeechSuperClue∗zh∣\\miden7\.19∣\\mid7\.5510\.38∣\\mid12\.519\.15∣\\mid6\.397\.91∣\\mid6\.947\.46∣\\mid7\.908\.39∣\\mid7\.38PhonePronunciation∗Phone accuracy93\.3%61\.3%86\.6%62\.7%67\.2%78\.0%LongSpeechGeneration∗wer∣\\midsim1\.83∣\\mid0\.6936\.30∣\\mid0\.597––––Control EffectivenessSpeechSuperClue∗20\-style effectiveness95\.0%61\.5%97\.5%–––Subjective Score / NaturalnessSpeechSuperClue∗ABX win rate72\.7%28\.0%74\.2%48\.0%66\.2%23\.1%1Content Stability and Multilingual test set are reported as WER \(lower is better\)\.2LongSpeechGeneration is reported as WER∣\\midspeaker similarity \(lower / higher is better\)\.3For PhonePronunciation accuracy, control effectiveness, and the subjective ABX win rate, higher is better\.4Multiple values are separated by∣\\mid, in the order of the subset shown under each benchmark\.
## 8Conclusion
We presented Qwen3\.8\-Omni\-Flash, a natively multimodal agentic model that advances omni models toward real\-world multimodal productivity\. Its native multimodal co\-training strategy preserves strong text capabilities while facilitating the transfer of reasoning and agentic capabilities to audio and video tasks, complemented by a 1M context window that supports long\-form understanding and long\-horizon planning\. Extensive evaluations demonstrate strong performance across multimodal understanding, reasoning, agentic execution, and video productivity, supporting its deployment as either a primary agent or a specialized sub\-agent\. To translate these capabilities into practical workflows, we introducedQwen\-MM\-Plugins, which integrates audiovisual capabilities into existing agent harnesses through information abstraction, selective content access, and reusable productivity tools\. We further introducedQwen\-Live\-Harnessto support responsive, real\-time multimodal agents through coordinated context and memory management, tool use, and sub\-agent delegation\. Together, Qwen3\.8\-Omni\-Flash and these open\-source frameworks highlight the value of jointly advancing model capabilities and system infrastructure, providing a practical foundation for multimodal agents that perform sustained reasoning, planning, and execution across research and production workflows\.
## 9Ethics Statement
Users generating content with this model should ensure that all input data are lawfully obtained and used, and obtain authorization from the individuals whose voices are used\. They must not infringe on individuals’ rights to their voices or other personality rights and must comply with applicable laws and regulations\. Synthetic audio made available to others must be labeled as AI\-generated as required by law\. Model deployers and users must fulfill their respective legal responsibilities\.
## References
- Alibaba Token Hub, Alibaba Group \(2026\)Alibaba Token Hub, Alibaba GroupOmnilingua\-Bench: multilingual omni\-modal evaluation of long audio recognition, multi\-speaker understanding, and instruction following\.Note:[https://github\.com/QwenLM/Omnilingua\-Bench](https://github.com/QwenLM/Omnilingua-Bench)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Anthropic \(2025\)AnthropicClaude 3\.7 sonnet and claude code\.Note:[https://www\.anthropic\.com/news/claude\-3\-7\-sonnet](https://www.anthropic.com/news/claude-3-7-sonnet)Accessed: 2026\-09\-03Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p1.1)\.
- Caoet al\.\(2026\)Z\. Cao, Y\. Zheng, R\. Song, and X\. HuAgenticVBench: can ai agents complete real\-world post\-production tasks?\.arXiv preprint arXiv:2605\.27705\.Cited by:[§6\.2\.1](https://arxiv.org/html/2609.25611#S6.SS2.SSS1.p1.1)\.
- Chaoet al\.\(2025\)J\. Chao, J\. Gao, W\. Tan, Y\. Sun, R\. Song, and L\. RuJointAVBench: A benchmark for joint audio\-visual reasoning evaluation\.CoRRabs/2512\.12772\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2512.12772),2512\.12772Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Chenet al\.\(2026a\)Q\. Chen, Y\. Chu, H\. He, Y\. Yang, Z\. Liu, Y\. Wang, Z\. Ma, R\. Xu, M\. Gao, Y\. Yan, L\. Wang, H\. Wang, W\. Huang, Y\. Chen, G\. Yang, Q\. Kong, J\. Xu, and X\. ChenOmni demand understanding: a benchmark for contextual user\-intent inference in multimodal interaction\.External Links:2609\.21392,[Link](https://arxiv.org/abs/2609.21392)Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Chenet al\.\(2024\)Y\. Chen, X\. Yue, C\. Zhang, X\. Gao, R\. T\. Tan, and H\. LiVoicebench: benchmarking llm\-based voice assistants\.arXiv preprint arXiv:2410\.17196\.Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Chenet al\.\(2026b\)Z\. Chen, C\. Duan, K\. Sun, B\. Li, Y\. Wang, M\. Zhang, and X\. LiuUniClawBench: a universal benchmark for proactive agents on real\-world tasks\.arXiv preprint arXiv:2607\.08768\.Cited by:[§6\.2\.1](https://arxiv.org/html/2609.25611#S6.SS2.SSS1.p1.1)\.
- Chenget al\.\(2026\)X\. Cheng, W\. Jia, C\. Wen, D\. Fu, Z\. Wang, X\. Zhang, and T\. JinVox\-infinity: benchmarking the limits of long\- context spoken language models\.Zenodo\.External Links:[Document](https://dx.doi.org/10.5281/zenodo.22868361),[Link](https://doi.org/10.5281/zenodo.22868361)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Conneauet al\.\(2022\)A\. Conneau, M\. Ma, S\. Khanuja, Y\. Zhang, V\. Axelrod, S\. Dalmia, J\. Riesa, C\. Rivera, and A\. BapnaFLEURS: few\-shot learning evaluation of universal representations of speech\.2022 IEEE Spoken Language Technology Workshop \(SLT\),pp\. 798–805\.External Links:[Link](https://api.semanticscholar.org/CorpusID:249062909)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Datacurve \(2026\)DatacurveDeepSWE\.Note:Benchmark version 1\.1\. Accessed: 2026\-09\-18External Links:[Link](https://deepswe.datacurve.ai/)Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- DeepSeek\-AI \(2025\)DeepSeek\-AIDeepSeek\-r1: incentivizing reasoning capability in llms via reinforcement learning\.arXiv preprint arXiv:2501\.12948\.Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p1.1)\.
- Denget al\.\(2025\)X\. Deng, J\. Da, E\. Pan, Y\. Y\. He, C\. Ide, K\. Garg, N\. Lauffer, A\. Park, N\. Pasari, C\. Rane,et al\.Swe\-bench pro: can ai agents solve long\-horizon software engineering tasks?\.arXiv preprint arXiv:2509\.16941\.Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Dinget al\.\(2025\)J\. Ding, S\. Long, C\. Pu, H\. Zhou, H\. Gao, X\. Gao, C\. He, Y\. Hou, F\. Hu, Z\. Li,et al\.Nl2repo\-bench: towards long\-horizon repository generation evaluation of coding agents\.arXiv preprint arXiv:2512\.12730\.Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Dinget al\.\(2026\)S\. Ding, X\. Dai, L\. Xing, S\. Ding, Z\. Liu, Y\. JingYi, P\. Yang, Z\. Zhang, X\. Wei, X\. Fang,et al\.Wildclawbench: a benchmark for real\-world, long\-horizon agent evaluation\.arXiv preprint arXiv:2605\.10912\.Cited by:[§6\.2\.1](https://arxiv.org/html/2609.25611#S6.SS2.SSS1.p1.1)\.
- Fuet al\.\(2026\)C\. Fu, H\. Yuan, Y\. Dong, Y\. Zhang, Y\. Shen, X\. Hu, X\. Li, J\. Su, C\. Long, X\. Xie, Y\. Xie, X\. Zheng, X\. Yang, H\. Cao, Y\. Wu, Z\. Liu, X\. Sun, C\. Shan, and R\. HeVideo\-mme\-v2: towards the next stage in benchmarks for comprehensive video understanding\.CoRRabs/2604\.05015\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2604.05015),2604\.05015Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Fuet al\.\(2021\)Y\. Fu, L\. Cheng, S\. Lv, Y\. Jv, Y\. Kong, Z\. Chen, Y\. Hu, L\. Xie, J\. Wu, H\. Bu, X\. Xu, J\. Du, and J\. ChenAISHELL\-4: an open source dataset for speech enhancement, separation, recognition and speaker diarization in conference scenario\.InInterspeech,External Links:[Link](https://api.semanticscholar.org/CorpusID:233181491)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Goelet al\.\(2026\)A\. Goel, S\. Ghosh, V\. Agarwal, N\. Anand, K\. Jayakumar, L\. Koroshinadze, Y\. Xu, K\. Lyons, J\. Case, K\. Sapra, K\. J\. Shih, S\. Gururani, A\. Shrivastava, R\. Duraiswami, D\. Manocha, A\. Tao, B\. Catanzaro, M\. Shoeybi, and W\. PingMMOU: A massive multi\-task omni understanding and reasoning benchmark for long and complex real\-world videos\.CoRRabs/2603\.14145\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2603.14145),2603\.14145Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Google \(2026\)GoogleGemini 3\.8 Flash\.Note:Gemini API documentation\. Accessed: 2026\-09\-18External Links:[Link](https://ai.google.dev/gemini-api/docs/models/gemini-3.8-flash)Cited by:[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1)\.
- Gosaiet al\.\(2026\)A\. Gosai, T\. Vuong, U\. Tyagi, S\. Li, W\. You, M\. Bavare, A\. Uçar, Z\. Fang, B\. Jang, B\. Liu, and Y\. HeAudio multichallenge: A multi\-turn evaluation of spoken dialogue systems on natural human interaction\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\), ACL 2026, San Diego, California, United States, July 2\-7, 2026,M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),pp\. 35740–35770\.External Links:[Link](https://doi.org/10.18653/v1/2026.acl-long.1654),[Document](https://dx.doi.org/10.18653/V1/2026.ACL-LONG.1654)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Hanet al\.\(2026\)M\. Han, Z\. Xing, X\. Cheng, Y\. Wang, J\. Lin, L\. Wang, Y\. Yan, Y\. Chu, Q\. Yang, and J\. XuOmni2Web: benchmarking audiovisual website development\.Zenodo\.External Links:[Document](https://dx.doi.org/10.5281/zenodo.22855767),[Link](https://doi.org/10.5281/zenodo.22855767)Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Heet al\.\(2026a\)H\. He, Y\. Chu, Q\. Chen, W\. Huang, Y\. Feng, M\. Zhu, Z\. Dai, H\. Xu, D\. Yang, C\. Wu, Z\. Liang, Z\. Liu, X\. Li, X\. Chen, X\. Cheng, Q\. Yang, J\. Xu, and Q\. KongOmniVChat: synthesizing, benchmarking, and training for native audio\-visual dialogue\.External Links:2609\.21465,[Link](https://arxiv.org/abs/2609.21465)Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Heet al\.\(2026b\)Z\. He, W\. Hong, Z\. Yang, Z\. Pan, M\. Liu, X\. Gu, and J\. TangVision2web: a hierarchical benchmark for visual website development with agent verification\.arXiv preprint arXiv:2603\.26648\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Honget al\.\(2025\)J\. Hong, S\. Yan, J\. Cai, X\. Jiang, Y\. Hu, and W\. XieWorldSense: evaluating real\-world omnimodal understanding for multimodal llms\.CoRRabs/2502\.04326\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Huanget al\.\(2026\)W\. Huang, Y\. Chu, M\. Gao, H\. He, and J\. XuAudioSpan: spanning the duration and depth of audio comprehension\.CoRRabs/2608\.26431\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2608.26431),2608\.26431Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Jainet al\.\(2024\)N\. Jain, K\. Han, A\. Gu, W\. Li, F\. Yan, T\. Zhang, S\. Wang, A\. Solar\-Lezama, K\. Sen, and I\. StoicaLiveCodeBench: holistic and contamination free evaluation of large language models for code\.CoRRabs/2403\.07974\.Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Khandpuret al\.\(2025\)K\. Khandpur, K\. Lieret, C\. E\. Jimenez, O\. Press, and J\. YangSWE\-bench Multilingual\.Note:Accessed: 2026\-09\-18External Links:[Link](https://www.swebench.com/multilingual.html)Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Kwonet al\.\(2026\)D\. Kwon, Q\. Wu, S\. Kuriya, J\. Koo, S\. Cui, Z\. Zhong, W\. Liao, H\. Wakaki, and Y\. MitsufujiMusTBENCH: benchmarking and advancing temporal grounding in music llms\.CoRRabs/2605\.29300\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2605.29300),2605\.29300Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Liet al\.\(2025\)C\. Li, Y\. Chen, Y\. Ji, J\. Xu, Z\. Cui, S\. Li, Y\. Zhang, J\. Tang, Z\. Song, D\. Zhang, Y\. He, H\. Liu, Y\. Wang, Q\. Wang, Z\. Wu, J\. Luo, Z\. Pan, W\. Xie, C\. Zhang, Z\. Wang, J\. Tian, Y\. Wang, Z\. Cao, M\. Dai, K\. Wang, R\. Wen, Y\. Ma, Y\. Pan, S\. Chang, T\. Taheri, H\. Xia, C\. Plachouras, E\. Benetos, Y\. Li, G\. Zhang, J\. Yang, T\. Peng, Z\. Wang, M\. Liu, J\. Peng, Z\. Zhang, and J\. LiuOmniVideoBench: towards audio\-visual understanding evaluation for omni mllms\.CoRRabs/2510\.10689\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2510.10689),2510\.10689Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Liet al\.\(2026\)X\. Li, W\. Jiao, J\. Jin, S\. Wang, G\. Dong, J\. Jin, H\. Wang, Y\. Wang, J\. Wen, Y\. Lu,et al\.OmniGAIA: towards native omni\-modal ai agents\.arXiv preprint arXiv:2602\.22897\.Cited by:[§6\.2\.1](https://arxiv.org/html/2609.25611#S6.SS2.SSS1.p1.1)\.
- Linet al\.\(2024\)J\. Lin, Z\. Fang, C\. Chen, Z\. Wan, F\. Luo, P\. Li, Y\. Liu, and M\. SunStreamingBench: assessing the gap for mllms to achieve streaming video understanding\.CoRRabs/2411\.03628\.External Links:[Link](https://doi.org/10.48550/arXiv.2411.03628),[Document](https://dx.doi.org/10.48550/ARXIV.2411.03628),2411\.03628Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Liuet al\.\(2026\)R\. Liu, Y\. Wang, J\. Xie, Y\. You, D\. Cai, J\. Lin, X\. Chen, Z\. Guo, Y\. Chu, Q\. Yang, X\. Cheng, J\. Xv, and Y\. ZhongOmniEcho: spatial audio understanding for embodied agents\.Zenodo\.External Links:[Document](https://dx.doi.org/10.5281/zenodo.22855748),[Link](https://doi.org/10.5281/zenodo.22855748)Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Maet al\.\(2026\)W\. Ma, J\. Wei, L\. Zhao, H\. Zhang, B\. Xiao, L\. Li, Q\. Yang, B\. Gao, Y\. Wang, R\. Li, J\. Dong, Z\. Sui, and F\. LuoMOPD: multi\-teacher on\-policy distillation for capability integration in llm post\-training\.ArXivabs/2606\.30406\.External Links:[Link](https://api.semanticscholar.org/CorpusID:289684667)Cited by:[§7\.1](https://arxiv.org/html/2609.25611#S7.SS1.p2.1)\.
- Maet al\.\(2025a\)Z\. Ma, Y\. Ma, Y\. Zhu, C\. Yang, Y\. Chao, R\. Xu, W\. Chen, Y\. Chen, Z\. Chen, J\. Cong, K\. Li, K\. Li, S\. Li, X\. Li, X\. Li, Z\. Lian, Y\. Liang, M\. Liu, Z\. Niu, T\. Wang, Y\. Wang, Y\. Wang, Y\. Wu, G\. Yang, J\. Yu, R\. Yuan, Z\. Zheng, Z\. Zhou, H\. Zhu, W\. Xue, E\. Benetos, K\. Yu, C\. E\. Siong, and X\. ChenMMAR: A challenging benchmark for deep reasoning in speech, audio, music, and their mix\.CoRRabs/2505\.13032\.External Links:[Link](https://doi.org/10.48550/arXiv.2505.13032),[Document](https://dx.doi.org/10.48550/ARXIV.2505.13032),2505\.13032Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Maet al\.\(2025b\)Z\. Ma, R\. Xu, Z\. Xing, Y\. Chu, Y\. Wang, J\. He, J\. Xu, P\. Heng, K\. Yu, J\. Lin,et al\.Omni\-captioner: data pipeline, models, and benchmark for omni detailed perception\.arXiv preprint arXiv:2510\.12720\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Meta \(2026\)MetaIntroducing Muse Code and Muse Spark 1\.2\.Note:Published August 5, 2026\. Accessed: 2026\-09\-18External Links:[Link](https://research.meta.ai/blog/introducing-muse-code-and-muse-spark-1-2)Cited by:[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1)\.
- Muet al\.\(2025\)B\. Mu, P\. Guo, Z\. Sun, S\. Wang, H\. Liu, M\. Shao, L\. Xie, E\. S\. Chng, L\. Xiao, Q\. Feng, and D\. WangSummary on the multilingual conversational speech language model challenge: datasets, tasks, baselines, and methods\.CoRRabs/2509\.13785\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2509.13785),2509\.13785Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Nguyenet al\.\(2025\)L\. T\. P\. Nguyen, Z\. Yu, S\. L\. Y\. Hang, S\. An, J\. Lee, Y\. Ban, S\. Chung, T\. Nguyen, J\. Maeng, S\. Lee,et al\.See, hear, and understand: benchmarking audiovisual human speech understanding in multimodal large language models\.arXiv preprint arXiv:2512\.02231\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- OpenAI \(2022\)OpenAIChatML\.External Links:[Link](https://github.com/openai/openai-python/blob/e389823ba013a24b4c32ce38fa0bd87e6bccae94/chatml.md)Cited by:[§4](https://arxiv.org/html/2609.25611#S4.p1.1)\.
- OpenAI \(2024\)OpenAIIntroducing openai o1\-preview\.Note:[https://openai\.com/index/introducing\-openai\-o1\-preview/](https://openai.com/index/introducing-openai-o1-preview/)Accessed: 2026\-09\-03Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p1.1)\.
- Phanet al\.\(2025\)L\. Phan, A\. Gatti, Z\. Han, N\. Li, J\. Hu, H\. Zhang, C\. B\. C\. Zhang, M\. Shaaban, J\. Ling, S\. Shi,et al\.Humanity’s last exam\.arXiv preprint arXiv:2501\.14249\.Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Pourrezaet al\.\(2025\)R\. Pourreza, R\. Dagli, A\. Bhattacharyya, S\. Panchal, G\. Berger, and R\. MemisevicCan vision\-language models answer face to face questions in the real\-world?\.arXiv preprint arXiv:2503\.19356\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Pyatkinet al\.\(2025\)V\. Pyatkin, S\. Malik, V\. Graf, H\. Ivison, S\. Huang, P\. Dasigi, N\. Lambert, and H\. HajishirziGeneralizing verifiable instruction following\.CoRRabs/2507\.02833\.External Links:[Link](https://doi.org/10.48550/arXiv.2507.02833),[Document](https://dx.doi.org/10.48550/ARXIV.2507.02833),2507\.02833Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Qiuet al\.\(2026\)Z\. Qiu, Z\. Wang, X\. Li, Y\. Li, Y\. Xu, Y\. Wang, H\. Zhang, R\. Men, B\. Mao, C\. Zhang,et al\.On the design of qwen3\. 8\-next architecture: evaluation, efficiency, and training stability\.arXiv preprint arXiv:2608\.30320\.Cited by:[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1),[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Qwen Team \(2026a\)Qwen TeamOn the design of Qwen3\.8\-Next architecture: evaluation, efficiency, and training stability\.Technical reportAlibaba Group\.Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p2.1),[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.SSS0.Px1.p1.1),[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.SSS0.Px2.p1.1),[§2\.2](https://arxiv.org/html/2609.25611#S2.SS2.p1.1),[item \(1\)](https://arxiv.org/html/2609.25611#S3.I1.i1.p1.1)\.
- Qwen Team \(2026b\)Qwen TeamQwen3\.5\-omni: technical report\.arXiv preprint arXiv:2604\.15804\.External Links:[Link](https://arxiv.org/abs/2604.15804)Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p2.1),[§1](https://arxiv.org/html/2609.25611#S1.p5.1),[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.SSS0.Px2.p2.1),[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.p1.1),[§3](https://arxiv.org/html/2609.25611#S3.p1.1),[§3](https://arxiv.org/html/2609.25611#S3.p2.1),[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1),[§6](https://arxiv.org/html/2609.25611#S6.p1.1),[§7\.1](https://arxiv.org/html/2609.25611#S7.SS1.p1.1)\.
- Qwen Team \(2026c\)Qwen TeamQwen3\.7\-plus: multimodal agent intelligence\.External Links:[Link](https://qwen.ai/blog?id=qwen3.7-plus)Cited by:[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1)\.
- Qwen Team \(2026d\)Qwen TeamQwen3\.8\-max: a new bar for coding and cowork\.External Links:[Link](https://qwen.ai/blog?id=qwen3.8)Cited by:[§1](https://arxiv.org/html/2609.25611#S1.p1.1),[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1)\.
- Rawleset al\.\(2025\)C\. Rawles, S\. Clinckemaillie, Y\. Chang, J\. Waltz, G\. Lau, M\. Fair, A\. Li, W\. Bishop, W\. Li, F\. Campbell\-Ajala,et al\.Androidworld: a dynamic benchmarking environment for autonomous agents\.InInternational Conference on Learning Representations,Vol\.2025,pp\. 406–441\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Reinet al\.\(2023\)D\. Rein, B\. L\. Hou, A\. C\. Stickland, J\. Petty, R\. Y\. Pang, J\. Dirani, J\. Michael, and S\. R\. BowmanGPQA: a graduate\-level Google\-proof Q&A benchmark\.CoRRabs/2311\.12022\.Cited by:[§6\.1\.1](https://arxiv.org/html/2609.25611#S6.SS1.SSS1.p1.1)\.
- Sakshiet al\.\(2024\)S\. Sakshi, U\. Tyagi, S\. Kumar, A\. Seth, R\. Selvakumar, O\. Nieto, R\. Duraiswami, S\. Ghosh, and D\. ManochaMMAU: a massive multi\-task audio understanding and reasoning benchmark\.External Links:2410\.19168,[Link](https://arxiv.org/abs/2410.19168)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Seed \(2026\)B\. SeedSeed2\. 0 model card: towards intelligence frontier for real\-world complexity\.arXiv preprint arXiv:2607\.00248\.Cited by:[§6](https://arxiv.org/html/2609.25611#S6.SS0.SSS0.Px1.p1.1)\.
- Sunet al\.\(2026\)L\. Sun, X\. Zhou, Z\. Li, Y\. Zhang, Y\. Wang, and W\. XieSpotSound: enhancing large audio\-language models with fine\-grained temporal grounding\.arXiv preprint arXiv:2604\.13023\.Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Taoet al\.\(2026\)K\. Tao, Y\. Zheng, X\. Jia, W\. Du, K\. Shao, H\. Wang, X\. Chen, X\. Jin, J\. Zhu, B\. Yu, W\. Wang, J\. Liu, C\. Qin, Y\. Zhang, M\. Yang, and H\. WangLVOmniBench: pioneering long audio\-video understanding evaluation for omnimodal llms\.CoRRabs/2603\.19217\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2603.19217),2603\.19217Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Team \(2025\)G\. R\. TeamGemini robotics: bringing AI into the physical world\.CoRRabs/2503\.20020\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Team \(2026\)Q\. TeamQwen3\-asr technical report\.External Links:2601\.21337,[Link](https://arxiv.org/abs/2601.21337)Cited by:[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.SSS0.Px2.p2.1)\.
- Wanget al\.\(2025a\)D\. Wang, J\. Wu, J\. Li, D\. Yang, X\. Chen, T\. Zhang, and H\. MengMMSU: A massive multi\-task spoken language understanding and reasoning benchmark\.CoRRabs/2506\.04779\.External Links:[Link](https://doi.org/10.48550/arXiv.2506.04779),[Document](https://dx.doi.org/10.48550/ARXIV.2506.04779),2506\.04779Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Wanget al\.\(2026a\)H\. Wang, Y\. Chu, X\. Cheng, Y\. Xi, M\. Gao, Q\. Chen, Y\. Yang, W\. Guo, Y\. Qin, and J\. XuLAMAR\-bench: evaluating long\-form and multi\-audio understanding and reasoning\.Zenodo\.External Links:[Document](https://dx.doi.org/10.5281/zenodo.22857938),[Link](https://doi.org/10.5281/zenodo.22857938)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Wanget al\.\(2026b\)J\. Wang, A\. Ping, Y\. Wang, Y\. Zhang, S\. Li, H\. Bian, Y\. Ren, Y\. Zhang, H\. Wang, H\. Chen, J\. Li, J\. Wang, Y\. Hu, Z\. Xu, Z\. Zhang, and J\. LiuOmniCap\-if: benchmarking and improving instruction following abilities for omni\-video captioning\.CoRRabs/2606\.08572\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2606.08572),2606\.08572Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Wanget al\.\(2024a\)K\. Wang, J\. Pan, W\. Shi, Z\. Lu, M\. Zhan, and H\. LiMeasuring multimodal mathematical reasoning with math\-vision dataset\.arXiv:2402\.14804\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Wanget al\.\(2024b\)W\. Wang, Z\. He, W\. Hong, Y\. Cheng, X\. Zhang, J\. Qi, S\. Huang, B\. Xu, Y\. Dong, M\. Ding, and J\. TangLVBench: an extreme long video understanding benchmark\.CoRRabs/2406\.08035\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Wanget al\.\(2025b\)Y\. Wang, X\. Meng, Y\. Wang, H\. Zhang, and D\. ZhaoProactiveVideoQA: A comprehensive benchmark evaluating proactive interactions in video large language models\.CoRRabs/2507\.09313\.External Links:[Link](https://doi.org/10.48550/arXiv.2507.09313),[Document](https://dx.doi.org/10.48550/ARXIV.2507.09313),2507\.09313Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Wanget al\.\(2024c\)Z\. Wang, M\. Xia, L\. He, H\. Chen, Y\. Liu, R\. Zhu, K\. Liang, X\. Wu, H\. Liu, S\. Malladi, A\. Chevalier, S\. Arora, and D\. ChenCharXiv: charting gaps in realistic chart understanding in multimodal llms\.arXiv preprint arXiv:2406\.18521\.Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Wecket al\.\(2026\)B\. Weck, P\. Puentes, A\. Poltronieri, S\. Prabhu, and D\. BogdanovHumMusQA: A human\-written music understanding QA benchmark dataset\.CoRRabs/2603\.27877\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2603.27877),2603\.27877Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- xAI \(2024\)xAIGrok\-1\.5 Vision Preview\.Note:Introduces the RealWorldQA benchmark\. Accessed: 2026\-09\-18External Links:[Link](https://x.ai/news/grok-1.5v)Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Xuet al\.\(2025a\)J\. Xu, Z\. Guo, J\. He, H\. Hu, T\. He, S\. Bai, K\. Chen, J\. Wang, Y\. Fan, K\. Dang,et al\.Qwen2\. 5\-omni technical report\.arXiv preprint arXiv:2503\.20215\.Cited by:[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.p1.1),[§5\.4](https://arxiv.org/html/2609.25611#S5.SS4.p1.1)\.
- Xuet al\.\(2025b\)J\. Xu, Z\. Guo, H\. Hu, Y\. Chu, X\. Wang, J\. He, Y\. Wang, X\. Shi, T\. He, X\. Zhu, Y\. Lv, Y\. Wang, D\. Guo, H\. Wang, L\. Ma, P\. Zhang, X\. Zhang, H\. Hao, Z\. Guo, B\. Yang, B\. Zhang, Z\. Ma, X\. Wei, S\. Bai, K\. Chen, X\. L\. Liu, P\. Wang, M\. Yang, D\. Liu, X\. Ren, B\. Zheng, R\. Men, F\. Zhou, B\. Yu, J\. Yang, L\. Yu, J\. Zhou, and J\. LinQwen3\-omni technical report\.ArXivabs/2509\.17765\.Cited by:[§2\.1](https://arxiv.org/html/2609.25611#S2.SS1.p1.1)\.
- Yanget al\.\(2025\)Y\. Yang, J\. Zhuang, G\. Sun, C\. Tang, Y\. Li, P\. Li, Y\. Jiang, W\. Li, Z\. Ma, and C\. ZhangAudio\-centric video understanding benchmark without text shortcut\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,pp\. 6580–6598\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
- Yanget al\.\(2022\)Z\. Yang, Y\. Chen, L\. Luo, R\. Yang, L\. Ye, G\. Cheng, J\. Xu, Y\. Jin, Q\. Zhang, P\. Zhang, L\. Xie, and Y\. YanOpen source magicdata\-ramc: A rich annotated mandarin conversational\(ramc\) speech dataset\.CoRRabs/2203\.16844\.External Links:[Link](https://doi.org/10.48550/arXiv.2203.16844),[Document](https://dx.doi.org/10.48550/ARXIV.2203.16844),2203\.16844Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Yanget al\.\(2026\)Z\. Yang, X\. Zhang, Z\. Bi, P\. Zhang, X\. Cheng, J\. Xu, B\. Yang, and S\. NakamuraMuLA\-bench: a multilingual long\-form audio understanding benchmark via multi\-tier auditing\.External Links:2609\.23416,[Link](https://arxiv.org/abs/2609.23416)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Yeet al\.\(2026\)B\. Ye, R\. Li, Q\. Yang, Y\. Liu, L\. Yao, H\. Lv, Z\. Xie, C\. An, L\. Li, L\. Kong, Q\. Liu, Z\. Sui, and T\. YangClaw\-eval: towards trustworthy evaluation of autonomous agents\.External Links:2604\.06132,[Link](https://arxiv.org/abs/2604.06132)Cited by:[§6\.1\.2](https://arxiv.org/html/2609.25611#S6.SS1.SSS2.p1.1)\.
- Yuet al\.\(2022\)F\. Yu, S\. Zhang, Y\. Fu, L\. Xie, S\. Zheng, Z\. Du, W\. Huang, P\. Guo, Z\. Yan, B\. Ma, X\. Xu, and H\. BuM2Met: the icassp 2022 multi\-channel multi\-party meeting transcription challenge\.InICASSP 2022 \- 2022 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),Vol\.,pp\. 6167–6171\.External Links:[Document](https://dx.doi.org/10.1109/ICASSP43922.2022.9746465)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Zanget al\.\(2025\)Y\. Zang, S\. O’Brien, T\. Berg\-Kirkpatrick, J\. McAuley, and Z\. NovackAre you really listening? boosting perceptual awareness in music\-qa benchmarks\.arXiv preprint arXiv:2504\.00369\.Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Zhanget al\.\(2022\)B\. Zhang, H\. Lv, P\. Guo, Q\. Shao, C\. Yang, L\. Xie, X\. Xu, H\. Bu, X\. Chen, C\. Zeng, D\. Wu, and Z\. PengWENETSPEECH: A 10000\+ hours multi\-domain mandarin corpus for speech recognition\.InIEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2022, Virtual and Singapore, 23\-27 May 2022,pp\. 6182–6186\.External Links:[Link](https://doi.org/10.1109/ICASSP43922.2022.9746682),[Document](https://dx.doi.org/10.1109/ICASSP43922.2022.9746682)Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Zhanget al\.\(2025\)L\. Zhang, J\. Zhang, B\. Lei, C\. Wu, A\. Liu, W\. Jia, and X\. ZhouWildSpeech\-bench: benchmarking end\-to\-end speechllms in the wild\.External Links:2506\.21875Cited by:[§6\.1\.3](https://arxiv.org/html/2609.25611#S6.SS1.SSS3.p1.1)\.
- Zhenget al\.\(2025\)C\. Zheng, S\. Liu, M\. Li, X\. Chen, B\. Yu, C\. Gao, K\. Dang, Y\. Liu, R\. Men, A\. Yang,et al\.Group sequence policy optimization\.arXiv preprint arXiv:2507\.18071\.Cited by:[§7\.1](https://arxiv.org/html/2609.25611#S7.SS1.p2.1)\.
- Zhouet al\.\(2025\)Z\. Zhou, R\. Wang, and Z\. WuDaily\-omni: towards audio\-visual reasoning with temporal alignment across modalities\.CoRRabs/2505\.17862\.Cited by:[§6\.1\.4](https://arxiv.org/html/2609.25611#S6.SS1.SSS4.p1.1)\.
## 10Authors
Core Contributors444Alphabetical order\. \* denotes the corresponding author\.
Bing Han Baosong Yang Dake Guo Dayiheng Liu∗ Fei Huang Hangrui Hu Hongkun Hao Hao Wang Hui Wang Junming Lin Jin Xu∗ Keda Tao Linhan Ma Pei Zhang Qize Yang Ruiyang Xu Shun Lei Ting He Xize Cheng Xun Gong Xian Shi Xiong Wang Xinfa Zhu Xinyu Zhang Xueyao Zhang Yunfei Chu Yuan Feng Yangze Li Yuanjun Lv Yongqi Wang Yue Wang Yuxuan Wang Yu Xi Yifan Yang Yang Zhang Zhifang Guo Zishan Guo Ziyue Jiang Zhanzhao Liu Zhenxin Lei Zhijun Wang
Contributors††footnotemark:
An Yang Bohua Chen Bingshen Mu Bochao Mao Buxiao Wu Bin Zhang Bo Zheng Bohan Zhang Chuqiao Kuang Chengpeng Li Chenhao Li Chenyuhao Wen Chenhan Yuan Donghua Cai Dehui Kong Dunjie Lu Feng Wang Fan Zhong Fan Zhou Gang Cheng Guangyu Yuan Hongqing Chen Haolin He Hongcheng Liu Haoyu Wang Haiyang Xu Hui Xu Haiquan Zhao Huaqing Zhang Jie Huang Jingbin Hu Jiayi Leng Jie Li Jiongnan Liu Jitong Liao Ju Li Jiahao Meng Jiaxuan Peng Jianhong Tu Jiaming Zhou Jianwei Zhang Junhao Zheng Keqin Chen Kexin Huang Kangdi Wang Lianghao Deng Lei Huang Lei Xie Lingchen Meng Liangzuo Sun Ling Wang Laiwen Zheng Leying Zhang Meng Gao Mianqiu Huang Minghao Han Mei Li Mingfeng Xue Man Yuan Mingkun Yang Muzhi Zhu Na Ni Pengfei Wang Qibing Bai Qi Chen Qidong Huang Que Shen Ruixun Liu Rui Men Rong Zhang Shuai Bai Su Hao Sibo Song Songsong Shao Tao Chen Tianyi Tang Wenxiang Guo Wen Huang Xie Chen Xionghui Chen Xudong Guo Xiao Li Xuejing Liu Xiaokai Peng Xingzhang Ren Xuancheng Ren Xipin Wei Xuechun Wang Xiaodong Xu Xi Zhang Yiheng Chen Yizhong Cao Yang Fan Yuan Ge Yufei He Yang Liu Yanpeng Li Yi Lu Yuxin Liu Yuxuan Liu Yongxing Ma Yunfei Mao Yang Su Yuchong Sun Yueran Song Yixuan Wang Yang Xu Yifan Ye Yinsong Yan Yuhuan You Yichang Zhang Yinger Zhang Zibo Bi Zihan Liu Zijian Lin Zihan Qiu Zhixiang Ruan Zekun Wang Zhiyong Wu Zhenghao Xing Zeyu Yang Zhaoqing Zhu Zhiyuan Zhu
## Acknowledgements
We thank the Qwen\-Audio team for their discussions and technical contributions regarding voice timbre in Qwen3\.8\-Omni\-Flash\-Realtime\.相似文章
Qwen3.8-Omni-Flash:全感官体验。智能交付(阅读时间18分钟)
Qwen3.8-Omni-Flash是一款全模态AI模型,拥有百万token上下文窗口,支持文本、图像、音频和视频输入,性能与Gemini 3.8 Flash相当或更优,现已在Qianwen AI平台上线。
Qwen3.5-Omni 技术报告
Qwen3.5-Omni 是一个千亿参数的多模态模型,具备先进的音视频理解与生成能力,引入了新颖的 Audio-Visual Vibe Coding,在215项基准测试中取得SOTA结果,同时与 Gemini-3.1 Pro 持平。
Alibaba 发布 Qwen 3.8 Omni Flash
Alibaba 已发布 Qwen 3.8 Omni Flash AI 模型,该模型可能具备多模态能力,并针对速度进行了优化。
Qwen3.7预览版登陆Arena(1分钟阅读)
阿里巴巴Qwen宣布两大重要模型发布:Qwen3-Omni,首个原生端到端全模态AI,统一处理文本、图像、音频和视频;以及Qwen3-Next-80B-A3B,一款超高效MoE模型,每个token激活30亿参数,实现了SOTA性能,推理速度比Qwen3-32B快10倍。
Qwen3.8-Flash-Next
Qwen 发布了 Qwen3.8-Flash-Next,这是一款开放权重的多模态 MoE 模型,拥有 125B tokens,但只有 6B 活跃参数,提供了性能提升,并作为 Qwen4 架构的早期预览。