1.2k citations · 2.8k across the 42 of their papers we have counts for
45 papers
A Theory of Topological Derivatives for Inverse Rendering of Geometry
Ishit Mehta, Manmohan Chandraker, Ravi Ramamoorthi
We introduce a theoretical framework for differentiable surface evolution that allows discrete topology changes through the use of topological derivatives for variational optimizat…
NeRFs: The Search for the Best 3D Representation
Ravi Ramamoorthi
Neural Radiance Fields or NeRFs have become the representation of choice for problems in view synthesis or image-based rendering, as well as in many other applications across compu…
Neural Free-Viewpoint Relighting for Glossy Indirect Illumination
Nithin Raghavan, Yan Xiao, Kai-En Lin +5
Precomputed Radiance Transfer (PRT) remains an attractive solution for real-time rendering of complex light transport effects such as glossy global illumination. After precomputati…
PVP: Personalized Video Prior for Editable Dynamic Portraits using StyleGAN
Kai-En Lin, Alex Trevithick, Keli Cheng +5
Portrait synthesis creates realistic digital avatars which enable users to interact with others in a compelling way. Recent advances in StyleGAN and its extensions have shown promi…
Real-Time Radiance Fields for Single-Image Portrait View Synthesis
Alex Trevithick, Matthew Chan, Michael Stengel +7
We present a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time. Given a single RGB input, our im…
Importance Sampling BRDF Derivatives
Yash Belhe, Bing Xu, Sai Praveen Bangaru +2
We propose a set of techniques to efficiently importance sample the derivatives of several BRDF models. In differentiable rendering, BRDFs are replaced by their differential BRDF c…
Factorized Inverse Path Tracing for Efficient and Accurate Material-Lighting Estimation
Liwen Wu, Rui Zhu, Mustafa B. Yaldiz +7
Inverse path tracing has recently been applied to joint material and lighting estimation, given geometry and multi-view HDR observations of an indoor scene. However, it has two maj…
A Generalized Ray Formulation For Wave-Optics Rendering
Shlomi Steinberg, Ravi Ramamoorthi, Benedikt Bitterli +3
Under ray-optical light transport, the classical ray serves as a linear and local "point query" of light's behaviour. Linearity and locality are crucial to the formulation of sophi…
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
Jiatao Gu, Alex Trevithick, Kai-En Lin +4
Novel view synthesis from a single image requires inferring occluded regions of objects and scenes whilst simultaneously maintaining semantic and physical consistency with the inpu…
Decorrelating ReSTIR Samplers via MCMC Mutations
Rohan Sawhney, Daqi Lin, Markus Kettunen +4
Monte Carlo rendering algorithms often utilize correlations between pixels to improve efficiency and enhance image quality. For real-time applications in particular, repeated reser…
Vision Transformer for NeRF-Based View Synthesis from a Single Input Image
Kai-En Lin, Lin Yen-Chen, Wei-Sheng Lai +3
Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate…
Physically-Based Editing of Indoor Scene Lighting from a Single Image
Zhengqin Li, Jia Shi, Sai Bi +6
We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that…
A Level Set Theory for Neural Implicit Evolution under Explicit Flows
Ishit Mehta, Manmohan Chandraker, Ravi Ramamoorthi
Coordinate-based neural networks parameterizing implicit surfaces have emerged as efficient representations of geometry. They effectively act as parametric level sets with the zero…
Scalar Spatiotemporal Blue Noise Masks
Alan Wolfe, Nathan Morrical, Tomas Akenine-Möller +1
Blue noise error patterns are well suited to human perception, and when applied to stochastic rendering techniques, blue noise masks (blue noise textures) minimize unwanted low-fre…
Learning Neural Transmittance for Efficient Rendering of Reflectance Fields
Mohammad Shafiei, Sai Bi, Zhengqin Li +3
Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under…
View Synthesis of Dynamic Scenes based on Deep 3D Mask Volume
Kai-En Lin, Guowei Yang, Lei Xiao +2
Image view synthesis has seen great success in reconstructing photorealistic visuals, thanks to deep learning and various novel representations. The next key step in immersive virt…
NeLF: Neural Light-transport Field for Portrait View Synthesis and Relighting
Tiancheng Sun, Kai-En Lin, Sai Bi +2
Human portraits exhibit various appearances when observed from different views under different lighting conditions. We can easily imagine how the face will look like in another set…
Modulated Periodic Activations for Generalizable Local Functional Representations
Ishit Mehta, Michaël Gharbi, Connelly Barnes +3
Multi-Layer Perceptrons (MLPs) make powerful functional representations for sampling and reconstruction problems involving low-dimensional signals like images,shapes and light fiel…
NeuMIP: Multi-Resolution Neural Materials
Alexandr Kuznetsov, Krishna Mullia, Zexiang Xu +2
We propose NeuMIP, a neural method for representing and rendering a variety of material appearances at different scales. Classical prefiltering (mipmapping) methods work well on si…
Light Stage Super-Resolution: Continuous High-Frequency Relighting
Tiancheng Sun, Zexiang Xu, Xiuming Zhang +6
The light stage has been widely used in computer graphics for the past two decades, primarily to enable the relighting of human faces. By capturing the appearance of the human subj…
Photon-Driven Neural Path Guiding
Shilin Zhu, Zexiang Xu, Tiancheng Sun +5
Although Monte Carlo path tracing is a simple and effective algorithm to synthesize photo-realistic images, it is often very slow to converge to noise-free results when involving c…
Real-Time Selfie Video Stabilization
Jiyang Yu, Ravi Ramamoorthi, Keli Cheng +2
We propose a novel real-time selfie video stabilization method. Our method is completely automatic and runs at 26 fps. We use a 1D linear convolutional network to directly infer th…
Neural Reflectance Fields for Appearance Acquisition
Sai Bi, Zexiang Xu, Pratul Srinivasan +6
We present Neural Reflectance Fields, a novel deep scene representation that encodes volume density, normal and reflectance properties at any 3D point in a scene using a fully-conn…
Deep Multi Depth Panoramas for View Synthesis
Kai-En Lin, Zexiang Xu, Ben Mildenhall +6
We propose a learning-based approach for novel view synthesis for multi-camera 360 panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing…