activity
20242026
most citedFunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs

9 citations · 19 across the 10 of their papers we have counts for

collaborators

10 papers

cs.CL2026

X2-NativeCursor: Native-Token Text Progress Tracking for Incremental-Text Streaming Codec TTS

Zehan Liu, Carl Chen, Rime Wen +7

Incremental-text streaming text-to-speech (TTS) needs online text progress tracking for synchronized highlighting, interruption handling, and dialogue-history updates. Input text a…

cs.SD2026

X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR

Zhiwei Lin, Kaiqi Fu, Rime Wen +5

Streaming automatic speech recognition (ASR) for real-time voice agents and full-duplex dialogue must provide accurate partial transcripts with low commit latency. Existing systems…

cs.CL2026

X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction

Kaiqi Fu, Rime Wen, Altman Lin +4

Accurate and responsive turn-taking is essential for spoken dialogue systems, which must distinguish in real time between user interruptions, backchannels that should be ignored, a…

cs.CL2026

X2Streaming-TTS: Causal Token-Level Text-to-Speech from Streaming Text with Speech-State Inheritance

Rime Wen, Zehan Liu, Shawn Qin +4

Streaming text-to-speech is essential for low-latency spoken dialogue systems, yet many systems wait for sentence-level text and are therefore only pseudo-streaming. True token-lev…

eess.AS2026

Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm

Bajian Xiang, Cheng Wen, Han Zhao +12

In this report, we present Qwen-Audio-3.0-TTS, a production-oriented speech synthesis system that jointly advances content consistency, speaker similarity, prosodic naturalness, au…

cs.CL2025

Fun-ASR Technical Report

Keyu An, Yanni Chen, Zhigao Chen +35

In recent years, automatic speech recognition (ASR) has witnessed transformative advancements driven by three complementary paradigms: data scaling, model size scaling, and deep in…

cs.SD2025★ 1 cited

CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training

Zhihao Du, Changfeng Gao, Yuxuan Wang +19

In our prior works, we introduced a scalable streaming speech synthesis model, CosyVoice 2, which integrates a large language model (LLM) and a chunk-aware flow matching (FM) model…

cs.CL2025★ 3 cited

MinMo: A Multimodal Large Language Model for Seamless Voice Interaction

Qian Chen, Yafeng Chen, Yanni Chen +33

Recent advancements in large language models (LLMs) and multimodal speech-text models have laid the groundwork for seamless voice interactions, enabling real-time, natural, and hum…

cs.SD2024★ 9 cited

FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs

Keyu An, Qian Chen, Chong Deng +30

This report introduces FunAudioLLM, a model family designed to enhance natural voice interactions between humans and large language models (LLMs). At its core are two innovative mo…

eess.AS2024★ 6 cited

Seed-ASR: Understanding Diverse Speech and Contexts with LLM-based Speech Recognition

Ye Bai, Jingping Chen, Jitong Chen +52

Modern automatic speech recognition (ASR) model is required to accurately transcribe diverse speech signals (from different domains, languages, accents, etc) given the specific con…