Publications (7)
Deep Multi Depth Panoramas for View Synthesis
Kai-En Lin, Zexiang Xu, Ben Mildenhall +6
We propose a learning-based approach for novel view synthesis for multi-camera 360 panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing…
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
Jiatao Gu, Alex Trevithick, Kai-En Lin +4
Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the inpu…
Neural Free-Viewpoint Relighting for Glossy Indirect Illumination
Nithin Raghavan, Yan Xiao, Kai-En Lin +5
Precomputed Radiance Transfer (PRT) remains an attractive solution for real-time rendering of complex light transport effects such as glossy global illumination. After precomputati…
PVP: Personalized Video Prior for Editable Dynamic Portraits using StyleGAN
Kai-En Lin, Alex Trevithick, Keli Cheng +5
Portrait synthesis creates realistic digital avatars which enable users to interact with others in a compelling way. Recent advances in StyleGAN and its extensions have shown promi…
NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting
Tiancheng Sun, Kai-En Lin, Sai Bi +2
Human portraits exhibit various appearances when observed from different views under different lighting conditions. We can easily imagine how the face will look like in another set…
View Synthesis of Dynamic Scenes based on Deep 3D Mask Volume
Kai-En Lin, Guowei Yang, Lei Xiao +2
Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virt…