8 papers · 1 filter
Talk Like You: Imitating How You Speak in Real-Time Talking Head Generation
Baiqin Wang, Zhixing Ding, Jijie Li +3
In daily life, each person exhibits unique speaking habits, leading to subtle yet consistent lip-shape variations even when pronouncing the same word. Although recent talking head…
Relightable 3D Avatar Reconstruction with Semantic-Adaptive Motion-Illumination Responses
Jiankuo Zhao, Xiangyu Zhu, Jijie Li +3
Reconstructing expressive and relightable 3D head avatars from monocular videos remains challenging in computer vision, as it requires accurate modeling of both non-rigid facial mo…
Towards Flexible, Natural, Efficient Interaction for Conversational Talking Face Generation
Baiqin Wang, Sen Chen, Jiankuo Zhao +3
Conversational talking face generation has recently attracted increasing attention, aiming to synthesize interactive talking videos where characters speak, listen, and respond dyna…
The Devil Is in the Leakage: A Disentangled Dual-Purification Framework for High-Fidelity Hairstyle Transfer
Jijie Li, Jiankuo Zhao, Xiangyu Zhu +1
Hairstyle transfer aims to synthesize a photorealistic portrait by transplanting the hairstyle from a reference image onto a source subject while preserving the source identity. Re…
STAvatar: Soft Binding and Temporal Density Control for Monocular 3D Head Avatars Reconstruction
Jiankuo Zhao, Xiangyu Zhu, Zidu Wang +1
Reconstructing high-fidelity and animatable 3D head avatars from monocular videos remains a challenging yet essential task. Existing methods based on 3D Gaussian Splatting typicall…
BFSM: 3D Bidirectional Face-Skull Morphable Model
Zidu Wang, Meng Xu, Miao Xu +5
Building a joint face-skull morphable model holds great potential for applications such as remote diagnostics, surgical planning, medical education, and physically based facial sim…
SRM-Hair: Single Image Head Mesh Reconstruction via 3D Morphable Hair
Zidu Wang, Jiankuo Zhao, Miao Xu +2
3D Morphable Models (3DMMs) have played a pivotal role as a fundamental representation or initialization for 3D avatar animation and reconstruction. However, extending 3DMMs to hai…
Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networks
Xiangyu Zhu, Chang Yu, Jiankuo Zhao +3
David Marr's seminal theory of vision proposes that the human visual system operates through a sequence of three stages, known as the 2D sketch, the 2.5D sketch, and the 3D model.…