Uncertainty for SVBRDF Acquisition using Frequency Analysis

Abstract

This paper aims to quantify uncertainty for SVBRDF acquisition in multi-view captures. Under uncontrolled illumination and unstructured viewpoints, there is no guarantee that the observations contain enough information to reconstruct the appearance properties of a captured object. We study this ambiguity, or uncertainty, using entropy and accelerate the analysis by using the frequency domain, rather than the domain of incoming and outgoing viewing angles. The result is a method that computes a map of uncertainty over an entire object within a millisecond. We find that the frequency model allows us to recover SVBRDF parameters with competitive performance, that the accelerated entropy computation matches results with a physically-based path tracer, and that there is a positive correlation between error and uncertainty. We then show that the uncertainty map can be applied to improve SVBRDF acquisition using capture guidance, sharing information on the surface, and using a diffusion model to inpaint uncertain regions. Our code is available at https://github.com/rubenwiersma/svbrdf_uncertainty.

Project page: https://svbrdf-uncertainty.github.io

References in corpus (8)

• Blended Diffusion for Text-driven Editing of Natural Images
• Single-Image SVBRDF Capture with a Rendering-Aware Deep Network
• Modeling Surface Appearance from a Single Photograph using Self-augmented Convolutional Neural Networks
• Two-shot Spatially-varying BRDF and Shape Estimation
• RGB$\leftrightarrow$X: Image decomposition and synthesis using material- and lighting-aware diffusion models
• Guided Fine-Tuning for Large-Scale Material Transfer
• Sparse Ellipsometry: Portable Acquisition of Polarimetric SVBRDF and Shape with Unstructured Flash Photography
• UMat: Uncertainty-Aware Single Image High Resolution Material Capture