5 papers
Multimodal Conversational Context for LLM-Based ASR: Data Construction, Training, and Benchmark
Longhao Li, Jian Tang, Yuxiang Kong +4
Conversational context provides semantic and acoustic cues across turns for automatic speech recognition (ASR), but relying on historical transcripts can propagate recognition erro…
Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm
Bajian Xiang, Cheng Wen, Han Zhao +12
In this report, we present Qwen-Audio-3.0-TTS, a production-oriented speech synthesis system that jointly advances content consistency, speaker similarity, prosodic naturalness, au…
Diffusion Reconstruction towards Generalizable Audio Deepfake Detection
Bo Cheng, Songjun Cao, Xiaoming Zhang +3
Achieving robust generalization against unseen attacks remains a challenge in Audio Deepfake Detection (ADD), driven by the rapid evolution of generative models. To address this, w…
A Multi-Stage Framework for Multimodal Controllable Speech Synthesis
Rui Niu, Weihao Wu, Jie Chen +2
Controllable speech synthesis aims to control the style of generated speech using reference input, which can be of various modalities. Existing face-based methods struggle with rob…
FreeCodec: A disentangled neural speech codec with fewer tokens
Youqiang Zheng, Weiping Tu, Yueteng Kang +5
Neural speech codecs have gained great attention for their outstanding reconstruction with discrete token representations. It is a crucial component in generative tasks such as spe…