4 papers
VoiceWeaver: Staged Learning of Structured Controls for Expressive Speech and Sound-Event Generation
Xiaosu Su, Yun Cao, Yiping Ni +1
Adding expressive and environmental controls to a speech generator requires learning heterogeneous attributes without losing earlier capabilities. VoiceWeaver addresses this proble…
Temporal Anchors and Editing Sensitivity in Partial Speech Spoofing: A Controlled Study
Xiaosu Su, Yun Cao, Yiping Ni +1
Partial-spoof detectors must reject synthetic content while accepting benign edits. We diagnose temporal anchors and boundary-consistency training using frozen WavLM features, nonl…
Controllable Expressive 3D Facial Animation via Diffusion in a Unified Multimodal Space
Kangwei Liu, Junwu Liu, Xiaowei Yi +2
Audio-driven emotional 3D facial animation encounters two significant challenges: (1) reliance on single-modal control signals (videos, text, or emotion labels) without leveraging…
DisentTalk: Cross-lingual Talking Face Generation via Semantic Disentangled Diffusion Model
Kangwei Liu, Junwu Liu, Yun Cao +2
Recent advances in talking face generation have significantly improved facial animation synthesis. However, existing approaches face fundamental limitations: 3DMM-based methods mai…