5 papers
SpatialPoint: Spatial-aware Point Prediction for Embodied Localization
Qiming Zhu, Zhirui Fang, Tianming Zhang +3
Embodied intelligence fundamentally requires a capability to determine where to act in 3D space. We formalize this requirement as embodied localization -- the problem of predicting…
3DRot: Rediscovering the Missing Primitive for RGB-Based 3D Augmentation
Shitian Yang, Deyu Li, Xiaoke Jiang +1
RGB-based 3D tasks, e.g., 3D detection, depth estimation, 3D keypoint estimation, still suffer from scarce, expensive annotations and a thin augmentation toolbox, since many image…
Coca-Splat: Collaborative Optimization for Camera Parameters and 3D Gaussians
Jiamin Wu, Hongyang Li, Xiaoke Jiang +2
In this work, we introduce Coca-Splat, a novel approach to addressing the challenges of sparse view pose-free scene reconstruction and novel view synthesis (NVS) by jointly optimiz…
HandOS: 3D Hand Reconstruction in One Stage
Xingyu Chen, Zhuheng Song, Xiaoke Jiang +3
Existing approaches of hand reconstruction predominantly adhere to a multi-stage framework, encompassing detection, left-right classification, and pose estimation. This paradigm in…
HumanMM: Global Human Motion Recovery from Multi-shot Videos
Yuhong Zhang, Guanlin Wu, Ling-Hao Chen +8
In this paper, we present a novel framework designed to reconstruct long-sequence 3D human motion in the world coordinates from in-the-wild videos with multiple shot transitions. S…