81 citations · 118 across the 13 of their papers we have counts for
16 papers
Controllable Light Diffusion for Portraits
David Futschik, Kelvin Ritland, James Vecore +5
We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired…
Learning Personalized High Quality Volumetric Head Avatars from Monocular RGB Videos
Ziqian Bai, Feitong Tan, Zeng Huang +12
We propose a method to learn a high-quality implicit 3D head avatar from a monocular RGB video captured in the wild. The learnt avatar is driven by a parametric face model to achie…
VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting
Feitong Tan, Sean Fanello, Abhimitra Meka +6
We propose VoLux-GAN, a generative framework to synthesize 3D-aware faces with convincing relighting. Our main contribution is a volumetric HDRI relighting method that can efficien…
HumanGPS: Geodesic PreServing Feature for Dense Human Correspondences
Feitong Tan, Danhang Tang, Mingsong Dou +9
In this paper, we address the problem of building dense correspondences between human images under arbitrary camera viewpoints and body poses. Prior art either assumes small motion…
GeLaTO: Generative Latent Textured Objects
Ricardo Martin-Brualla, Rohit Pandey, Sofien Bouaziz +2
Accurate modeling of 3D objects exhibiting transparency, reflections and thin structures is an extremely challenging problem. Inspired by billboards and geometric proxies used in c…
Learning Illumination from Diverse Portraits
Chloe LeGendre, Wan-Chun Ma, Rohit Pandey +5
We present a learning-based technique for estimating high dynamic range (HDR), omnidirectional illumination from a single low dynamic range (LDR) portrait image captured under arbi…
Neural Light Transport for Relighting and View Synthesis
Xiuming Zhang, Sean Fanello, Yun-Ta Tsai +10
The light transport (LT) of a scene describes how it appears under different lighting and viewing directions, and complete knowledge of a scene's LT enables the synthesis of novel…
Portrait Shadow Manipulation
Xuaner Cecilia Zhang, Jonathan T. Barron, Yun-Ta Tsai +4
Casually-taken portrait photographs often suffer from unflattering lighting and shadowing because of suboptimal conditions in the environment. Aesthetic qualities such as the posit…
State of the Art on Neural Rendering
Ayush Tewari, Ohad Fried, Justus Thies +16
Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic imag…
Volumetric Capture of Humans with a Single RGBD Camera via Semi-Parametric Learning
Rohit Pandey, Anastasia Tkach, Shuoran Yang +9
Volumetric (4D) performance capture is fundamental for AR/VR content generation. Whereas previous work in 4D performance capture has shown impressive results in studio settings, th…
Neural Rerendering in the Wild
Moustafa Meshry, Dan B Goldman, Sameh Khamis +4
We explore total scene capture -- recording, modeling, and rerendering a scene under varying appearance such as season and time of day. Starting from internet photos of a tourist l…
LookinGood: Enhancing Performance Capture with Real-time Neural Re-Rendering
Ricardo Martin-Brualla, Rohit Pandey, Shuoran Yang +14
Motivated by augmented and virtual reality applications such as telepresence, there has been a recent focus in real-time performance capture of humans under motion. However, given…
Egocentric 6-DoF Tracking of Small Handheld Objects
Rohit Pandey, Pavel Pidlypenskyi, Shuoran Yang +1
Virtual and augmented reality technologies have seen significant growth in the past few years. A key component of such systems is the ability to track the pose of head mounted disp…
Real-time Egocentric Gesture Recognition on Mobile Head Mounted Displays
Rohit Pandey, Marie White, Pavel Pidlypenskyi +2
Mobile virtual reality (VR) head mounted displays (HMD) have become popular among consumers in recent years. In this work, we demonstrate real-time egocentric hand gesture detectio…
Maximum Entropy Binary Encoding for Face Template Protection
Rohit Kumar Pandey, Yingbo Zhou, Bhargava Urala Kota +1
In this paper we present a framework for secure identification using deep neural networks, and apply it to the task of template protection for face authentication. We use deep conv…
Deep Secure Encoding: An Application to Face Recognition
Rohit Pandey, Yingbo Zhou, Venu Govindaraju
In this paper we present Deep Secure Encoding: a framework for secure classification using deep neural networks, and apply it to the task of biometric template protection for faces…