40 citations · 110 across the 33 of their papers we have counts for
34 papers
Luna-TTS Family Technical Report
Feng Yin, Shuai Shi, Junjie Zheng +19
Modern text-to-speech (TTS) is dominated by autoregressive (AR) codec language models, whose left-to-right decoding brings latency that grows with utterance length, error accumulat…
Towards Array-Invariant Speech Enhancement via Geometry-Aware Dynamic Convolution
Zhenglong Liu, Wangyou Zhang, Chenda Li +1
Multi-channel speech enhancement (SE) systems exhibit superior performance over single-channel methods but are constrained to fixed microphone array configurations. This restricts…
ESPnet3: Infrastructure for Scalable Speech and Audio Research in the Foundation Model Era
Masao Someki, Alexander Polok, Carlos Carvalho +14
Recent speech research involves increasingly large datasets, complex models, and diverse experimental workflows. However, existing frameworks require substantial engineering effort…
TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separation
Qinzhe Hu, Chenda Li, Wangyou Zhang +3
Recent advances in speech separation (SS) have led to compact front-end models with small parameter sizes, yet their high computational cost remains a major barrier for deployment…
Representation-Regularized Convolutional Audio Transformer for Audio Understanding
Bing Han, Chushu Zhou, Yifan Yang +4
Bootstrap-based Self-Supervised Learning (SSL) has achieved remarkable progress in audio understanding. However, existing methods typically operate at a single level of granularity…
SLM-SS: Speech Language Model for Generative Speech Separation
Tianhua Li, Chenda Li, Wei Wang +4
Speech separation (SS) has advanced significantly with neural network-based methods, showing improved performance on signal-level metrics. However, these methods often struggle to…
UrgentMOS: Unified Multi-Metric and Preference Learning for Robust Speech Quality Assessment
Wei Wang, Wangyou Zhang, Chenda Li +12
Automatic speech quality assessment has become increasingly important as modern speech generation systems continue to advance, while human listening tests remain costly, time-consu…
ICASSP 2026 URGENT Speech Enhancement Challenge
Chenda Li, Wei Wang, Marvin Sach +8
The ICASSP 2026 URGENT Challenge advances the series by focusing on universal speech enhancement (SE) systems that handle diverse distortions, domains, and input conditions. This o…
USE: A Unified Model for Universal Sound Separation and Extraction
Hongyu Wang, Chenda Li, Xin Zhou +2
Sound separation (SS) and target sound extraction (TSE) are fundamental techniques for addressing complex acoustic scenarios. While existing SS methods struggle with determining th…
PURE Codec: Progressive Unfolding of Residual Entropy for Speech Codec Learning
Jiatong Shi, Haoran Wang, William Chen +4
Neural speech codecs have achieved strong performance in low-bitrate compression, but residual vector quantization (RVQ) often suffers from unstable training and ineffective decomp…
MeanSE: Efficient Generative Speech Enhancement with Mean Flows
Jiahe Wang, Hongyu Wang, Wei Wang +5
Speech enhancement (SE) improves degraded speech's quality, with generative models like flow matching gaining attention for their outstanding perceptual quality. However, the flow-…
P.808 Multilingual Speech Enhancement Testing: Approach and Results of URGENT 2025 Challenge
Marvin Sach, Yihui Fu, Kohei Saijo +9
In speech quality estimation for speech enhancement (SE) systems, subjective listening tests so far are considered as the gold standard. This should be even more true considering t…
URGENT-PK: Perceptually-Aligned Ranking Model Designed for Speech Enhancement Competition
Jiahe Wang, Chenda Li, Wei Wang +11
The Mean Opinion Score (MOS) is fundamental to speech quality assessment. However, its acquisition requires significant human annotation. Although deep neural network approaches, s…
Efficient Multilingual ASR Finetuning via LoRA Language Experts
Jiahong Li, Yiwen Shao, Jianheng Zhuo +4
Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and availabl…
Lessons Learned from the URGENT 2024 Speech Enhancement Challenge
Wangyou Zhang, Kohei Saijo, Samuele Cornell +10
The URGENT 2024 Challenge aims to foster speech enhancement (SE) techniques with great universality, robustness, and generalizability, featuring a broader task definition, large-sc…
Interspeech 2025 URGENT Speech Enhancement Challenge
Kohei Saijo, Wangyou Zhang, Samuele Cornell +9
There has been a growing effort to develop universal speech enhancement (SE) to handle inputs with various speech distortions and recording conditions. The URGENT Challenge series…
Improving Speech Enhancement with Multi-Metric Supervision from Learned Quality Assessment
Wei Wang, Wangyou Zhang, Chenda Li +3
Speech quality assessment (SQA) aims to predict the perceived quality of speech signals under a wide range of distortions. It is inherently connected to speech enhancement (SE), wh…
Scale This, Not That: Investigating Key Dataset Attributes for Efficient Speech Enhancement Scaling
Leying Zhang, Wangyou Zhang, Chenda Li +1
Recent speech enhancement models have shown impressive performance gains by scaling up model complexity and training data. However, the impact of dataset variability (e.g. text, la…
Diffusion-based Generative Modeling with Discriminative Guidance for Streamable Speech Enhancement
Chenda Li, Samuele Cornell, Shinji Watanabe +1
Diffusion-based generative models (DGMs) have recently attracted attention in speech enhancement research (SE) as previous works showed a remarkable generalization capability. Howe…
URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement
Wangyou Zhang, Robin Scheibler, Kohei Saijo +9
The last decade has witnessed significant advancements in deep learning-based speech enhancement (SE). However, most existing SE research has limitations on the coverage of SE sub-…
Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement
Wangyou Zhang, Kohei Saijo, Jee-weon Jung +3
Deep learning-based speech enhancement (SE) models have achieved impressive performance in the past decade. Numerous advanced architectures have been designed to deliver state-of-t…
SpeechComposer: Unifying Multiple Speech Tasks with Prompt Composition
Yihan Wu, Soumi Maiti, Yifan Peng +6
Recent advancements in language models have significantly enhanced performance in multiple speech-related tasks. Existing speech language models typically utilize task-dependent pr…
Adapting Multi-Lingual ASR Models for Handling Multiple Talkers
Chenda Li, Yao Qian, Zhuo Chen +5
State-of-the-art large-scale universal speech models (USMs) show a decent automatic speech recognition (ASR) performance across multiple domains and languages. However, it remains…
Target Sound Extraction with Variable Cross-modality Clues
Chenda Li, Yao Qian, Zhuo Chen +5
Automatic target sound extraction (TSE) is a machine learning approach to mimic the human auditory perception capability of attending to a sound source of interest from a mixture o…