5 papers
ViDS: Video Diffusion Shader using 3D Face Tracking
Wenbo Ji, Davide Davoli, Zhe Chen +3
We introduce ViDS, a Video Diffusion Shader that leverages 3D face tracking for expressive and identity-preserving portrait animation. We first reconstruct the identity-specific 3D…
FactorPortrait: Controllable Portrait Animation via Disentangled Expression, Pose, and Viewpoint
Jiapeng Tang, Kai Li, Chengxiang Yin +8
We introduce FactorPortrait, a video diffusion method for controllable portrait animation that enables lifelike synthesis from disentangled control signals of facial expressions, h…
ROGR: Relightable 3D Objects using Generative Relighting
Jiapeng Tang, Matthew Levine, Dor Verbin +5
We introduce ROGR, a novel approach that reconstructs a relightable 3D model of an object captured from multiple views, driven by a generative relighting model that simulates the e…
SHeaP: Self-Supervised Head Geometry Predictor Learned via 2D Gaussians
Liam Schoneveld, Zhe Chen, Davide Davoli +4
Accurate, real-time 3D reconstruction of human heads from monocular images and videos underlies numerous visual applications. As 3D ground truth data is hard to come by at scale, p…
GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusion
Jiapeng Tang, Davide Davoli, Tobias Kirschstein +2
We propose a novel approach for reconstructing animatable 3D Gaussian avatars from monocular videos captured by commodity devices like smartphones. Photorealistic 3D head avatar re…