5 papers
M3DHMR: Monocular 3D Hand Mesh Recovery
Yihong Lin, Xianjia Wu, Xilai Wang +4
Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less…
GLDiTalker: Speech-Driven 3D Facial Animation with Graph Latent Diffusion Transformer
Yihong Lin, Zhaoxin Fan, Xianjia Wu +6
Speech-driven talking head generation is a critical yet challenging task with applications in augmented reality and virtual human modeling. While recent approaches using autoregres…
EmoFace: Emotion-Content Disentangled Speech-Driven 3D Talking Face Animation
Yihong Lin, Liang Peng, Zhaoxin Fan +5
The creation of increasingly vivid 3D talking face has become a hot topic in recent years. Currently, most speech-driven works focus on lip synchronisation but neglect to effective…
SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
Lingyu Xiong, Xize Cheng, Jintao Tan +7
Audio-driven talking face generation aims to synthesize video with lip movements synchronized to input audio. However, current generative techniques face challenges in preserving i…
Landmark-guided Diffusion Model for High-fidelity and Temporally Coherent Talking Head Generation
Jintao Tan, Xize Cheng, Lingyu Xiong +6
Audio-driven talking head generation is a significant and challenging task applicable to various fields such as virtual avatars, film production, and online conferences. However, t…