6 papers
EgoAgent: A Joint Predictive Agent Model in Egocentric Worlds
Lu Chen, Yizhou Wang, Shixiang Tang +6
Learning an agent model that behaves like humans-capable of jointly perceiving the environment, predicting the future, and taking actions from a first-person perspective-is a funda…
Hulk: A Universal Knowledge Translator for Human-Centric Tasks
Yizhou Wang, Yixuan Wu, Weizhen He +8
Human-centric perception tasks, e.g., pedestrian detection, skeleton-based action recognition, and pose estimation, have wide industrial applications, such as metaverse and sports…
PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm
Haoyi Zhu, Honghui Yang, Xiaoyang Wu +8
In contrast to numerous NLP and 2D vision foundational models, learning a 3D foundational model poses considerably greater challenges. This is primarily due to the inherent data va…
Depth Any Video with Scalable Synthetic Data
Honghui Yang, Di Huang, Wei Yin +6
Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introd…
GUPNet++: Geometry Uncertainty Propagation Network for Monocular 3D Object Detection
Yan Lu, Xinzhu Ma, Lei Yang +6
Geometry plays a significant role in monocular 3D object detection. It can be used to estimate object depth by using the perspective projection between object's physical size and 2…
NeuRodin: A Two-stage Framework for High-Fidelity Neural Surface Reconstruction
Yifan Wang, Di Huang, Weicai Ye +3
Signed Distance Function (SDF)-based volume rendering has demonstrated significant capabilities in surface reconstruction. Although promising, SDF-based methods often fail to captu…