4 papers · 1 filter
DiffHuman: Probabilistic Photorealistic 3D Reconstruction of Humans
Akash Sengupta, Thiemo Alldieck, Nikos Kolotouros +3
We present DiffHuman, a probabilistic method for photorealistic 3D human reconstruction from a single RGB image. Despite the ill-posed nature of this problem, most methods are dete…
VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis
Enric Corona, Andrei Zanfir, Eduard Gabriel Bazavan +3
We propose VLOGGER, a method for audio-driven human video generation from a single input image of a person, which builds on the success of recent generative diffusion models. Our m…
SPHEAR: Spherical Head Registration for Complete Statistical 3D Modeling
Eduard Gabriel Bazavan, Andrei Zanfir, Thiemo Alldieck +3
We present \emph{SPHEAR}, an accurate, differentiable parametric statistical 3D human head model, enabled by a novel 3D registration method based on spherical embeddings. We shift…
Blendshapes GHUM: Real-time Monocular Facial Blendshape Prediction
Ivan Grishchenko, Geng Yan, Eduard Gabriel Bazavan +5
We present Blendshapes GHUM, an on-device ML pipeline that predicts 52 facial blendshape coefficients at 30+ FPS on modern mobile phones, from a single monocular RGB image and enab…