87 citations · 163 across the 34 of their papers we have counts for
4 papers · 1 filter
Talking Head Generation with Audio and Speech Related Facial Action Units
Sen Chen, Zhilei Liu, Jiaxing Liu +2
The task of talking head generation is to synthesize a lip synchronized talking head video by inputting an arbitrary face image and audio clips. Most existing methods ignore the lo…
Using multiple reference audios and style embedding constraints for speech synthesis
Cheng Gong, Longbiao Wang, Zhenhua Ling +2
The end-to-end speech synthesis model can directly take an utterance as reference audio, and generate speech from the text with prosody and speaker characteristics similar to the r…
Information Sieve: Content Leakage Reduction in End-to-End Prosody For Expressive Speech Synthesis
Xudong Dai, Cheng Gong, Longbiao Wang +1
Expressive neural text-to-speech (TTS) systems incorporate a style encoder to learn a latent embedding as the style information. However, this embedding process may encode redundan…
Exploring Deep Learning for Joint Audio-Visual Lip Biometrics
Meng Liu, Longbiao Wang, Kong Aik Lee +3
Audio-visual (AV) lip biometrics is a promising authentication technique that leverages the benefits of both the audio and visual modalities in speech communication. Previous works…