9 papers
OmniContact: Chaining Meta-Skills via Contact Flow for Generalizable Humanoid Loco-Manipulation
Runyi Yu, Xiaoyi Lin, Ji Ma +11
Learning long-horizon humanoid loco-manipulation poses a dual challenge: it requires not only the robust execution of meta-skills but also their seamless, closed-loop chaining equi…
EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos
Hongming Fu, Wenjia Wang, Xiaozhen Qiao +5
We propose EgoGrasp, the first method to reconstruct world-space hand-object interactions (W-HOI) from dynamic egoview videos, supporting open-vocabulary objects. Accurate W-HOI re…
EgoReAct: Egocentric Video-Driven 3D Human Reaction Generation
Libo Zhang, Zekun Li, Tianyu Li +10
Humans exhibit adaptive, context-sensitive responses to egocentric visual input. However, faithfully modeling such reactions from egocentric video remains challenging due to the du…
Diffusion Models are Efficient Data Generators for Human Mesh Recovery
Yongtao Ge, Wenjia Wang, Yongfan Chen +4
Despite remarkable progress having been made on the problem of 3D human pose and shape estimation (HPS), current state-of-the-art methods rely heavily on either confined indoor moc…
TokenHSI: Unified Synthesis of Physical Human-Scene Interactions through Task Tokenization
Liang Pan, Zeshi Yang, Zhiyang Dou +5
Synthesizing diverse and physically plausible Human-Scene Interactions (HSI) is pivotal for both computer animation and embodied AI. Despite encouraging progress, current methods m…
Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors
Yuke Lou, Yiming Wang, Zhen Wu +4
Human-object interaction (HOI) synthesis is important for various applications, ranging from virtual reality to robotics. However, acquiring 3D HOI data is challenging due to its c…