205 citations · 306 across the 16 of their papers we have counts for
17 papers
Differentiable Polarized Path Tracing
Pramod Rao, Jérémy Riviere, Xilong Zhou +6
Physically based differentiable rendering has proven to be a powerful tool for inverse rendering problems (e.g., 3D reconstruction, reflectance estimation, lighting estimation). Ho…
LegacyAvatars: Volumetric Face Avatars For Traditional Graphics Pipelines
Safa C. Medin, Gengyan Li, Ziqian Bai +8
We introduce a novel representation for efficient classical rendering of photorealistic 3D face avatars. Leveraging recent advances in radiance fields anchored to parametric face m…
3DPR: Single Image 3D Portrait Relight using Generative Priors
Pramod Rao, Abhimitra Meka, Xilong Zhou +11
Rendering novel, relit views of a human head, given a monocular portrait image as input, is an inherently underconstrained problem. The traditional graphics solution is to explicit…
EgoSocial: Benchmarking Proactive Intervention Ability of Omnimodal LLMs via Egocentric Social Interaction Perception
Xijun Wang, Tanay Sharma, Achin Kulshrestha +3
As AR/VR technologies become integral to daily life, there's a growing need for AI that understands human social dynamics from an egocentric perspective. However, current LLMs ofte…
TeGA: Texture Space Gaussian Avatars for High-Resolution Dynamic Head Modeling
Gengyan Li, Paulo Gotardo, Timo Bolkart +5
Sparse volumetric reconstruction and rendering via 3D Gaussian splatting have recently enabled animatable 3D head avatars that are rendered under arbitrary viewpoints with impressi…
Cafca: High-quality Novel View Synthesis of Expressive Faces from Casual Few-shot Captures
Marcel C. Bühler, Gengyan Li, Erroll Wood +13
Volumetric modeling and neural radiance field representations have revolutionized 3D face capture and photorealistic novel view synthesis. However, these methods often require hund…
Lite2Relight: 3D-aware Single Image Portrait Relighting
Pramod Rao, Gereon Fox, Abhimitra Meka +8
Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate…
FaceFolds: Meshed Radiance Manifolds for Efficient Volumetric Rendering of Dynamic Faces
Safa C. Medin, Gengyan Li, Ruofei Du +5
3D rendering of dynamic face captures is a challenging problem, and it demands improvements on several fronts$\unicode{x2014}$photorealism, efficiency, compatibility, and configura…
One2Avatar: Generative Implicit Head Avatar For Few-shot User Adaptation
Zhixuan Yu, Ziqian Bai, Abhimitra Meka +6
Traditional methods for constructing high-quality, personalized head avatars from monocular videos demand extensive face captures and training time, posing a significant challenge…
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold
Xingang Pan, Ayush Tewari, Thomas Leimkühler +3
Synthesizing visual content that meets users' needs often requires flexible and precise controllability of the pose, shape, expression, and layout of the generated objects. Existin…
Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos
Ziqian Bai, Feitong Tan, Zeng Huang +12
We propose a method to learn a high-quality implicit 3D head avatar from a monocular RGB video captured in the wild. The learnt avatar is driven by a parametric face model to achie…
EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes
Gengyan Li, Abhimitra Meka, Franziska Müller +3
A unique challenge in creating high-quality animatable and relightable 3D avatars of people is modeling human eyes. The challenge of synthesizing eyes is multifold as it requires 1…
VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting
Feitong Tan, Sean Fanello, Abhimitra Meka +6
We propose VoLux-GAN, a generative framework to synthesize 3D-aware faces with convincing relighting. Our main contribution is a volumetric HDRI relighting method that can efficien…
Self-supervised Outdoor Scene Relighting
Ye Yu, Abhimitra Meka, Mohamed Elgharib +3
Outdoor scene relighting is a challenging problem that requires good understanding of the scene geometry, illumination and albedo. Current techniques are completely supervised, req…
VariTex: Variational Neural Face Textures
Marcel C. Bühler, Abhimitra Meka, Gengyan Li +2
Deep generative models can synthesize photorealistic images of human faces with novel identities. However, a key challenge to the wide applicability of such techniques is to provid…
Real-Time Global Illumination Decomposition of Videos
Abhimitra Meka, Mohammad Shafiei, Michael Zollhoefer +2
We propose the first approach for the decomposition of a monocular color video into direct and indirect illumination components in real time. We retrieve, in separate layers, the c…
LIME: Live Intrinsic Material Estimation
Abhimitra Meka, Maxim Maximov, Michael Zollhoefer +4
We present the first end to end approach for real time material estimation for general object shapes with uniform material that only requires a single color image as input. In addi…