ResearchResearch paperSpeech & Audio · Multimodal Models2 sources · Oct 20, 2026

Qwen-Audio-3.1-ASR Technical Report

We present Qwen-Audio-3.1-ASR, a family of audio-language models that builds upon its predecesor Qwen-Audio-3.0-ASR with improved speech recognition and expanded capabilities in speaker-diarized transcription and general audio understanding.

Key points

  • Speaker-diarized ASR produces structured outputs containing speaker labels, timestamps, and recognized text, maintaining consistent speaker labels across turns and the representation of overlapping speech.
  • The general audio understanding capabilities cover audio-, speech-, and music-captioning, temporal grounding and sound event detection, as well as audio question answering and multiple-choice reasoning.
  • To accommodate different deployment requirements, the family includes variants for asynchronous file transcription, low-latency streaming, interactive voice input, and non-streaming recognition, with speaker-diarized transcription and general audio understanding available in certain variants.
  • Evaluations span conventional ASR, multilingual and dialectal speech, speaker-diarized transcription, and general audio understanding, demonstrating the capabilities of the Qwen-Audio-3.1-ASR family across transcription and broader audio analysis tasks.

Sources (2)

  • [1]Qwen-Audio-3.1-ASR Technical Report
    Hugging Face Daily Papers · Oct 20, 12:00 AM
    We present Qwen-Audio-3.1-ASR, a family of audio-language models that builds upon its predecesor Qwen-Audio-3.0-ASR with improved speech recognition and expanded capabilities in speaker-diarized transcription and general audio understanding.
    Speaker-diarized ASR produces structured outputs containing speaker labels, timestamps, and recognized text, maintaining consistent speaker labels across turns and the representation of overlapping speech.
  • [2]Qwen-Audio-3.1-ASR Technical Report
    arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 20, 05:08 PM · same content

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 19, 2026Reading Time Modeling with Pixel-Based Language Models
  2. Oct 19, 2026SAPO: Self-Supervised Attention Policy Optimization for Improving Temporal Video Grounding in Vision-Language Models
  3. Oct 18, 2026A failure of Imagination: VLMs fail to use visual representations for text, but self-distillation can help
  4. Oct 18, 2026Dual-Slot: From Serial Loops to Parallel Slots in Language Models
  5. Oct 18, 2026P2N: Reusing Deep Representations for Greater Effective Depth
  6. Oct 17, 2026A Symmetry-Matching Approach to Blind-Spot Reduction in Sparse Autoencoders

Related