309 citations · 880 across the 12 of their papers we have counts for
14 papers
DifFRelight: Diffusion-Based Facial Performance Relighting
Mingming He, Pascal Clausen, Ahmet Levent Taşel +8
We present a novel framework for free-viewpoint facial performance relighting using diffusion-based image-to-image translation. Leveraging a subject-specific dataset containing div…
Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization
Dmitriy Smirnov, Chloe LeGendre, Xueming Yu +1
We introduce Magenta Green Screen, a novel machine learning--enabled matting technique for recording the color image of a foreground actor and a simultaneous high-quality alpha cha…
Jointly Optimizing Color Rendition and In-Camera Backgrounds in an RGB Virtual Production Stage
Chloe LeGendre, Lukas Lepicovsky, Paul Debevec
While the LED panels used in virtual production systems can display vibrant imagery with a wide color gamut, they produce problematic color shifts when used as lighting due to thei…
HDR Lighting Dilation for Dynamic Range Reduction on Virtual Production Stages
Paul Debevec, Chloe LeGendre
We present a technique to reduce the dynamic range of an HDRI lighting environment map in an efficient, energy-preserving manner by spreading out the light of concentrated light so…
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination
Xiuming Zhang, Pratul P. Srinivasan, Boyang Deng +3
We address the problem of recovering the shape and spatially-varying reflectance of an object from multi-view images (and their camera poses) of an object illuminated by one unknow…
A New Dimension in Testimony: Relighting Video with Reflectance Field Exemplars
Loc Huynh, Bipin Kishore, Paul Debevec
We present a learning-based method for estimating 4D reflectance field of a person given video footage illuminated under a flat-lit environment of the same subject. For training da…