10 papers
AnyBand: Unified Multi-Bandwidth Speech Extension via Frequency-Aware In-Context Spectral Infilling
Junchuan Zhao, Minh Duc Vu, Bowen Zhang +1
Bandwidth extension (BWE) aims to recover missing high-frequency content from band-limited speech. Existing methods often formulate BWE as a fixed or predefined bandwidth conversio…
MSpoofTTS: Multi-Resolution Spoof-Guided Inference for Discrete Speech Synthesis
Junchuan Zhao, Minh Duc Vu, Ye Wang
Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade pe…
TED-TTS: Training-Free Intra-Utterance Emotion and Duration Control for Text-to-Speech Synthesis
Qifan Liang, Yuansen Liu, Ruixin Wei +3
While controllable Text-to-Speech (TTS) has achieved notable progress, most existing methods remain limited to inter-utterance-level control, making fine-grained intra-utterance ex…
Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems
Leduo Chen, Junchuan Zhao, Shengchen Li
Timbre transfer aims to modify the timbral identity of a musical recording while preserving the original melody and rhythm. While single-instrument timbre transfer has made substan…
PersonaGest: Personalized Co-Speech Gesture Generation with Semantic-Guided Hierarchical Motion Representation
Junchuan Zhao, Qifan Liang, Ye Wang
Co-speech gesture generation aims to synthesize realistic body movements that are semantically coherent with speech and faithful to a user-specified gestural style. Existing VQ-VAE…
KSDiff: Keyframe-Augmented Speech-Aware Dual-Path Diffusion for Facial Animation
Tianle Lyu, Junchuan Zhao, Ye Wang
Audio-driven facial animation has made significant progress in multimedia applications, with diffusion models showing strong potential for talking-face synthesis. However, most exi…