7 papers
Generative Relightable Avatars
Kunwar Maheep Singh, Christian Theobalt, Rishabh Dabral
We present Generative Relightable Avatars (GRA), a person-specific method for photorealistic free-view rendering and environment-map relighting of full-body humans. We postulate th…
ReFree: Towards Realistic Co-Speech Video Generation via Reward-Free RL and Multilevel Speech Guidance
Salaheldin Mohamed, M. Hamza Mughal, Rishabh Dabral +1
Speech-driven talking character animation seeks to generate life-like portrait videos that convey natural conversation behavior, aligning facial motion with spoken audio. Although…
CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration
Adil Meric, Lin Geng Foo, Mert Kiray +3
We present CoMoGen, a controllable video generation framework that generates realistic interactive dynamics from a single binary mask sequence conditioned on an input image. CoMoGe…
FunRec: Reconstructing Functional 3D Scenes from Egocentric Interaction Videos
Alexandros Delitzas, Chenyangguang Zhang, Alexey Gavryushin +8
We present FunRec, a method for reconstructing functional 3D digital twins of indoor scenes directly from egocentric RGB-D interaction videos. Unlike existing methods on articulate…
Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactions
Ayce Idil Aytekin, Xu Chen, Zhengyang Shen +4
We present Grasp in Gaussians (GraG), a fast and robust method for reconstructing dynamic 3D hand-object interactions from a single monocular video. Unlike recent approaches that o…
EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents
Wenjia Wang, Liang Pan, Huaijin Pi +8
Human behaviors in the real world naturally encode rich, long-term contextual information that can be leveraged to train embodied agents for perception, understanding, and acting.…