5 papers
Detail Enhanced Gaussian Splatting for Large-Scale Volumetric Capture
Julien Philip, Li Ma, Pascal Clausen +8
We present a unique system for large-scale, multi-performer, high resolution 4D volumetric capture providing realistic free-viewpoint video up to and including 4K resolution facial…
Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures
Yuancheng Xu, Wenqi Xian, Li Ma +10
We introduce a framework that enables both multi-view character consistency and 3D camera control in video diffusion models through a novel customization data pipeline. We train th…
Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise
Ryan Burgert, Yuancheng Xu, Wenqi Xian +10
Generative modeling aims to transform random noise into structured outputs. In this work, we enhance video diffusion models by allowing motion control via structured latent noise s…
Fitting Spherical Gaussians to Dynamic HDRI Sequences
Pascal Clausen, Li Ma, Mingming He +3
We present a technique for fitting high dynamic range illumination (HDRI) sequences using anisotropic spherical Gaussians (ASGs) while preserving temporal consistency in the compre…
DifFRelight: Diffusion-Based Facial Performance Relighting
Mingming He, Pascal Clausen, Ahmet Levent TaÅel +8
We present a novel framework for free-viewpoint facial performance relighting using diffusion-based image-to-image translation. Leveraging a subject-specific dataset containing div…