118 citations · 370 across the 64 of their papers we have counts for
73 papers
Brain2Face: A Study on the Relation of EEG Signals and Spatio-temporal Head Avatars
Camilo Andrés Martínez Martínez, Olaf Dünkel, Kartik Teotia +3
Driving digital head avatars is classically done by hand-crafted artist design or by image-based facial performance capture. In this work, we ask whether spatio-temporal tracking o…
AvatarDynamizer: From Static to Dynamic Human Avatars via Generative Dynamic Textures
Guoxing Sun, Heming Zhu, Linjie Lyu +3
For full-body avatars, modeling surface dynamics is crucial for overcoming the uncanny valley and achieving perceptual realism. Person-agnostic methods recover static 3D avatars fr…
STEER: Steerable Dyadic Head Avatars
Kartik Teotia, Helge Rhodin, Hyeongwoo Kim +2
Facial movement and expression are central to face-to-face communication, conveying turn-taking, attention, agreement, and engagement alongside speech. While speech-driven facial a…
SOMA: From Surface Observations to Muscle Anatomy
Eduardo Alvarado, Emily Kim, Gerrit Nolte +4
With the growing demand for realistic virtual humans, parametric body models have become a cornerstone of modern medicine, sports, and entertainment applications. However, most of…
Differentiable Polarized Path Tracing
Pramod Rao, Jérémy Riviere, Xilong Zhou +6
Physically based differentiable rendering has proven to be a powerful tool for inverse rendering problems (e.g., 3D reconstruction, reflectance estimation, lighting estimation). Ho…
Towards Real-World Wearable Motion Reconstruction
Andrea Boscolo Camiletto, Rishabh Dabral, Eduardo Alvarado +3
The modern-day surge in popularity of wearable devices poses a fundamentally unique motion capture problem: reconstructing full-body movement from any set of sensing hardware worn…
EgoRelight: Egocentric Human Capture and Illumination Recovery for Relightable and Photoreal Avatar Rendering
Jianchun Chen, Yinda Zhang, Rohit Pandey +3
Mixed Reality (MR) headsets promise a future of immersive telepresence where virtual humans blend indistinguishably into real or virtual surroundings. Achieving this vision require…
D-Rex : Diffusion Rendering for Relightable Expressive Avatars
Timo Teufel, Xilong Zhou, Umar Iqbal +4
We present D-Rex, a person-specific framework for photorealistic, relightable, expressive, and animatable full-body human avatars with free-viewpoint rendering. Existing methods fo…
MUA: Mobile Ultra-detailed Animatable Avatars
Heming Zhu, Guoxing Sun, Marc Habermann
Building photorealistic, animatable full-body digital humans remains a longstanding challenge in computer graphics and vision. Recent advances in animatable avatar modeling have la…
HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images
Yumeng Liu, Xiao-Xiao Long, Marc Habermann +5
Recovering high-fidelity 3D hand geometry from images is a critical task in computer vision, holding significant value for domains such as robotics, animation and VR/AR. Crucially,…
DInf-Grid: A Neural Differential Equation Solver with Differentiable Feature Grids
Navami Kairanda, Shanthika Naik, Marc Habermann +3
We present a novel differentiable grid-based representation for efficiently solving differential equations (DEs). Widely used architectures for neural solvers, such as sinusoidal n…
RelightAnyone: A Generalized Relightable 3D Gaussian Head Model
Yingyan Xu, Pramod Rao, Sebastian Weiss +5
3D Gaussian Splatting (3DGS) has become a standard approach to reconstruct and render photorealistic 3D head avatars. A major challenge is to relight the avatars to match any scene…
OLATverse: A Large-scale Real-world Object Dataset with Precise Lighting Control
Xilong Zhou, Jianchun Chen, Pramod Rao +7
We introduce OLATverse, a large-scale dataset comprising around 9M images of 765 real-world objects, captured from multiple viewpoints under a diverse set of precisely controlled l…
Relightable Holoported Characters: Capturing and Relighting Dynamic Human Performance from Sparse Views
Kunwar Maheep Singh, Jianchun Chen, Vladislav Golyanik +5
We present Relightable Holoported Characters (RHC), a novel person-specific method for free-view rendering and relighting of full-body and highly dynamic humans solely observed fro…
3DPR: Single Image 3D Portrait Relight using Generative Priors
Pramod Rao, Abhimitra Meka, Xilong Zhou +11
Rendering novel, relit views of a human head, given a monocular portrait image as input, is an inherently underconstrained problem. The traditional graphics solution is to explicit…
Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles
Jose Luis Ponton, Eduardo Alvarado, Lin Geng Foo +3
Human motion is fundamentally driven by continuous physical interaction with the environment. Whether walking, running, or simply standing, the forces exchanged between our feet an…
Audio-Driven Universal Gaussian Head Avatars
Kartik Teotia, Helge Rhodin, Mohit Mendiratta +3
We introduce the first method for audio-driven universal photorealistic avatar synthesis, combining a person-agnostic speech model with our novel Universal Head Avatar Prior (UHAP)…
Topology-Aware Optimization of Gaussian Primitives for Human-Centric Volumetric Videos
Yuheng Jiang, Chengcheng Guo, Yize Wu +9
Volumetric video is emerging as a key medium for digitizing the dynamic physical world, creating the virtual environments with six degrees of freedom to deliver immersive user expe…
Hyper Diffusion Avatars: Dynamic Human Avatar Generation using Network Weight Space Diffusion
Dongliang Cao, Guoxing Sun, Marc Habermann +1
Creating human avatars is a highly desirable yet challenging task. Recent advancements in radiance field rendering have achieved unprecedented photorealism and real-time performanc…
Physics-based Human Pose Estimation from a Single Moving RGB Camera
Ayce Idil Aytekin, Chuqiao Li, Diogo Luvizon +4
Most monocular and physics-based human pose tracking methods, while achieving state-of-the-art results, suffer from artifacts when the scene does not have a strictly flat ground pl…
UMA: Ultra-detailed Human Avatars via Multi-level Surface Alignment
Heming Zhu, Guoxing Sun, Christian Theobalt +1
Learning an animatable and clothed human avatar model with vivid dynamics and photorealistic appearance from multi-view videos is an important foundational research problem in comp…
EVA: Expressive Virtual Avatars from Multi-view Videos
Hendrik Junkawitsch, Guoxing Sun, Heming Zhu +2
With recent advancements in neural rendering and motion capture algorithms, remarkable progress has been made in photorealistic human avatar modeling, unlocking immense potential f…
Matrix-free Second-order Optimization of Gaussian Splats with Residual Sampling
Hamza Pehlivan, Andrea Boscolo Camiletto, Lin Geng Foo +2
3D Gaussian Splatting (3DGS) is widely used for novel view synthesis due to its high rendering quality and fast inference time. However, 3DGS predominantly relies on first-order op…
GIGA: Generalizable Sparse Image-driven Gaussian Humans
Anton Zubekhin, Heming Zhu, Paulo Gotardo +3
Driving a high-quality and photorealistic full-body virtual human from a few RGB cameras is a challenging problem that has become increasingly relevant with emerging virtual realit…