9 papers · 1 filter
RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning
Qian Wang, Longrui Chen, Peiran Sun +8
Visual imitation learning enables robots to acquire visuomotor skills directly from images, yet RGB observations lack explicit geometric cues, making learned policies brittle to ca…
PointMapPolicy: Structured Point Cloud Processing for Multi-Modal Imitation Learning
Xiaogang Jia, Qian Wang, Anrui Wang +12
Robotic manipulation systems benefit from complementary sensing modalities, where each provides unique environmental information. Point clouds capture detailed geometric structure,…
IRIS: An Immersive Robot Interaction System
Xinkai Jiang, Qihao Yuan, Enes Ulas Dincer +11
This paper introduces IRIS, an Immersive Robot Interaction System leveraging Extended Reality (XR). Existing XR-based systems enable efficient data collection but are often challen…
Beyond Visuals: Investigating Force Feedback in Extended Reality for Robot Data Collection
Xueyin Li, Xinkai Jiang, Philipp Dahlinger +2
This work explores how force feedback affects various aspects of robot data collection within the Extended Reality (XR) setting. Force feedback has been proved to enhance the user…
X-IL: Exploring the Design Space of Imitation Learning Policies
Xiaogang Jia, Atalay Donat, Xi Huang +8
Designing modern imitation learning (IL) policies requires making numerous decisions, including the selection of feature encoding, architecture, policy representation, and more. As…
Towards Fusing Point Cloud and Visual Representations for Imitation Learning
Atalay Donat, Xiaogang Jia, Xi Huang +7
Learning for manipulation requires using policies that have access to rich sensory information such as point clouds or RGB images. Point clouds efficiently capture geometric struct…