5 papers
Q-GeoMem: Question-Guided Geometric Memory for Video Spatial Reasoning
Xianqiang Gao, Qizhi Chen, Delin Qu +5
Video spatial reasoning requires accumulating viewpoint-dependent evidence over time while retaining information useful to the question being asked. Existing spatial video-language…
EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy
Jinzhao Li, Yinuo Chen, Dongxu Piao +9
Humans constantly reason about 3D proximity, the relations between their body and surrounding objects, to guide perception and action in daily life. Whether multimodal large langua…
Openfly: A comprehensive platform for aerial vision-language navigation
Yunpeng Gao, Chenhui Li, Zhongrui You +20
Vision-Language Navigation (VLN) aims to guide agents by leveraging language instructions and visual cues, playing a pivotal role in embodied AI. Indoor VLN has been extensively st…
FastUMI-100K: Advancing Data-driven Robotic Manipulation with a Large-scale UMI-style Dataset
Kehui Liu, Zhongjie Jia, Yang Li +14
Data-driven robotic manipulation learning depends on large-scale, high-quality expert demonstration datasets. However, existing datasets, which primarily rely on human teleoperated…
Trajectory Conditioned Cross-embodiment Skill Transfer
YuHang Tang, Yixuan Lou, Pengfei Han +4
Learning manipulation skills from human demonstration videos presents a promising yet challenging problem, primarily due to the significant embodiment gap between human body and ro…