7 papers
CoMoGen: COntrollable MOtion Dynamics and Interactions with Mask-Guided Video GENeration
Adil Meric, Lin Geng Foo, Mert Kiray +3
We present CoMoGen, a controllable video generation framework that generates realistic interactive dynamics from a single binary mask sequence conditioned on an input image. CoMoGe…
VHOI: Controllable Video Generation of Human-Object Interactions from Sparse Trajectories via Motion Densification
Wanyue Zhang, Lin Geng Foo, Thabo Beeler +2
Synthesizing realistic human-object interactions (HOI) in video is challenging due to the complex, instance-specific interaction dynamics of both humans and objects. Incorporating…
Step2Motion: Locomotion Reconstruction from Pressure Sensing Insoles
Jose Luis Ponton, Eduardo Alvarado, Lin Geng Foo +3
Human motion is fundamentally driven by continuous physical interaction with the environment. Whether walking, running, or simply standing, the forces exchanged between our feet an…
Physical Simulator In-the-Loop Video Generation
Lin Geng Foo, Mark He Huang, Alexandros Lattas +3
Recent advances in diffusion-based video generation have achieved remarkable visual realism but still struggle to obey basic physical laws such as gravity, inertia, and collision.…
Matrix-free Second-order Optimization of Gaussian Splats with Residual Sampling
Hamza Pehlivan, Andrea Boscolo Camiletto, Lin Geng Foo +2
3D Gaussian Splatting (3DGS) is widely used for novel view synthesis due to its high rendering quality and fast inference time. However, 3DGS predominantly relies on first-order op…
OnlineSplatter: Pose-Free Online 3D Reconstruction for Free-Moving Objects
Mark He Huang, Lin Geng Foo, Christian Theobalt +2
Free-moving object reconstruction from monocular video remains challenging, particularly without reliable pose or depth cues and under arbitrary object motion. We introduce OnlineS…