10 papers
HEIGHT: Heterogeneous Interaction Graph Transformer for Robot Navigation in Crowded and Constrained Environments
Shuijing Liu, Haochen Xia, Fatemeh Cheraghi Pouria +5
We study the problem of robot navigation in dense and interactive crowds with static constraints such as corridors and furniture. Previous methods fail to consider all types of spa…
ComposableNav: Instruction-Following Navigation in Dynamic Environments via Composable Diffusion
Zichao Hu, Chen Tang, Michael J. Munje +6
This paper considers the problem of enabling robots to navigate dynamic environments while following instructions. The challenge lies in the combinatorial nature of instruction spe…
Tool-as-Interface: Learning Robot Policies from Observing Human Tool Use
Haonan Chen, Cheng Zhu, Shuijing Liu +2
Tool use is essential for enabling robots to perform complex real-world tasks, but learning such skills requires extensive datasets. While teleoperation is widely used, it is slow,…
MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos
Rutav Shah, Shuijing Liu, Qi Wang +5
We aim to enable humanoid robots to efficiently solve new manipulation tasks from a few video examples. In-context learning (ICL) is a promising framework for achieving this goal d…
SocialNav-SUB: Benchmarking VLMs for Scene Understanding in Social Robot Navigation
Michael J. Munje, Chen Tang, Shuijing Liu +6
Robot navigation in dynamic, human-centered environments requires socially-compliant decisions grounded in robust scene understanding. Recent Vision-Language Models (VLMs) exhibit…
Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models
Huihan Liu, Rutav Shah, Shuijing Liu +6
Assistive teleoperation, where control is shared between a human and a robot, enables efficient and intuitive human-robot collaboration in diverse and unstructured environments. A…