6 papers
UniCon3R: Unified Contact-aware 4D Human-Scene Reconstruction from Monocular Video
Tanuj Sur, Shashank Tripathi, Nikos Athanasiou +4
We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffe…
Leveraging RGB Images for Pre-Training of Event-Based Hand Pose Estimation
Ruicong Liu, Takehiko Ohkawa, Tze Ho Elden Tse +3
This paper presents RPEP, the first pre-training method for event-based 3D hand pose estimation using labeled RGB images and unpaired, unlabeled event data. Event data offer signif…
Improving Human Motion Plausibility with Body Momentum
Ha Linh Nguyen, Tze Ho Elden Tse, Angela Yao
Many studies decompose human motion into local motion in a frame attached to the root joint and global motion of the root joint in the world frame, treating them separately. Howeve…
TIGeR: Text-Instructed Generation and Refinement for Template-Free Hand-Object Interaction
Yiyao Huang, Zhedong Zheng, Yu Ziwei +3
Pre-defined 3D object templates are widely used in 3D reconstruction of hand-object interactions. However, they often require substantial manual efforts to capture or source, and i…
A Constrained Optimization Approach for Gaussian Splatting from Coarsely-posed Images and Noisy Lidar Point Clouds
Jizong Peng, Tze Ho Elden Tse, Kai Xu +2
3D Gaussian Splatting (3DGS) is a powerful reconstruction technique, but it needs to be initialized from accurate camera poses and high-fidelity point clouds. Typically, the initia…
DAS3R: Dynamics-Aware Gaussian Splatting for Static Scene Reconstruction
Kai Xu, Tze Ho Elden Tse, Jizong Peng +1
We propose a novel framework for scene decomposition and static background reconstruction from everyday videos. By integrating the trained motion masks and modeling the static scen…