6 papers
ProxyPose: 6-DoF Pose Tracking via Video-to-Video Translation
Ruihang Zhang, Felix Taubner, Pooja Ravi +2
Tracking the six-degree-of-freedom (6-DoF) pose of objects and surfaces from monocular video is a long-standing problem in computer vision. To tackle this problem, existing methods…
Grow with the Flow: 4D Reconstruction of Growing Plants with Gaussian Flow Fields
Weihan Luo, Lily Goli, Sherwin Bahmani +3
Modeling the time-varying 3D appearance of plants during growth poses unique challenges: unlike most dynamic scenes, plants continuously generate new geometry as they expand, branc…
Generating the Past, Present and Future from a Motion-Blurred Image
SaiKiran Tedla, Kelly Zhu, Trevor Canham +4
We seek to answer the question: what can a motion-blurred image reveal about a scene's past, present, and future? Although motion blur obscures image details and degrades visual qu…
MVP4D: Multi-View Portrait Video Diffusion for Animatable 4D Avatars
Felix Taubner, Ruihang Zhang, Mathieu Tuli +2
Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. Howev…
PrismAvatar: Real-time animated 3D neural head avatars on edge devices
Prashant Raina, Felix Taubner, Mathieu Tuli +2
We present PrismAvatar: a 3D head avatar model which is designed specifically to enable real-time animation and rendering on resource-constrained edge devices, while still enjoying…
CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models
Felix Taubner, Ruihang Zhang, Mathieu Tuli +1
Reconstructing photorealistic and dynamic portrait avatars from images is essential to many applications including advertising, visual effects, and virtual reality. Depending on th…