40 citations · 191 across the 46 of their papers we have counts for
6 papers · 1 filter
BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective
Andong Li, Tong Lei, Rilin Chen +5
This paper revisits the neural vocoder task through the lens of audio restoration and propose a novel diffusion vocoder called BridgeVoC. Specifically, by rank analysis, we compare…
LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learning
Kang Yang, Yifan Liang, Fangkun Liu +2
Lip-to-speech (L2S) synthesis for Mandarin is a significant challenge, hindered by complex viseme-to-phoneme mappings and the critical role of lexical tones in intelligibility. To…
Rethinking the joint estimation of magnitude and phase for time-frequency domain neural vocoders
Lingling Dai, Andong Li, Tong Lei +3
Time-frequency (T-F) domain-based neural vocoders have shown promising results in synthesizing high-fidelity audio. Nevertheless, it remains unclear on the mechanism of effectively…
Learning Neural Vocoder from Range-Null Space Decomposition
Andong Li, Tong Lei, Zhihang Sun +4
Despite the rapid development of neural vocoders in recent years, they usually suffer from some intrinsic challenges like opaque modeling, and parameter-performance trade-off. In t…
NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing
Yifan Liang, Fangkun Liu, Andong Li +2
Recent advancements in visual speech recognition (VSR) have promoted progress in lip-to-speech synthesis, where pre-trained VSR models enhance the intelligibility of synthesized sp…
Neural Vocoders as Speech Enhancers
Andong Li, Zhihang Sun, Fengyuan Hao +2
Speech enhancement (SE) and neural vocoding are traditionally viewed as separate tasks. In this work, we observe them under a common thread: the rank behavior of these processes. T…