4 papers · 1 filter
Under One Sun: Multi-Object Generative Perception of Materials and Illumination
Nobuo Yoshii, Xinran Nicole Han, Ryo Kawahara +2
We introduce Multi-Object Generative Perception (MultiGP), a generative inverse rendering method for stochastic sampling of all radiometric constituents -- reflectance, texture, an…
Ultra Flash: Scaling Real-Time Streaming Video Generation to High Resolutions
Luxury, Jie Huang, Zihao Fan +25
While recent autoregressive video diffusion models achieve remarkable streaming quality, they remain confined to low resolutions (e.g., 480P), leaving efficient, scalable, real-tim…
Generative Perception of Shape and Material from Differential Motion
Xinran Nicole Han, Ko Nishino, Todd Zickler
Perceiving the shape and material of an object from a single image is inherently ambiguous, especially when lighting is unknown and unconstrained. Despite this, humans can often di…
Multistable Shape from Shading Emerges from Patch Diffusion
Xinran Nicole Han, Todd Zickler, Ko Nishino
Models for inferring monocular shape of surfaces with diffuse reflection -- shape from shading -- ought to produce distributions of outputs, because there are fundamental mathemati…