4 papers
Searching in Space and Time: Unified Memory-Action Loops for Open-World Object Retrieval
Taijing Chen, Sateesh Kumar, Junhong Xu +3
Service robots must retrieve objects in dynamic, open-world settings where requests may reference attributes ("the red mug"), spatial context ("the mug on the table"), or past stat…
GET-USE: Learning Generalized Tool Usage for Bimanual Mobile Manipulation via Simulated Embodiment Extensions
Bohan Wu, Paul de La Sayette, Li Fei-Fei +1
The ability to use random objects as tools in a generalizable manner is a missing piece in robots' intelligence today to boost their versatility and problem-solving capabilities. S…
MoMaGen: Generating Demonstrations under Soft and Hard Constraints for Multi-Step Bimanual Mobile Manipulation
Chengshu Li, Mengdi Xu, Arpit Bahety +11
Imitation learning from large-scale, diverse human demonstrations has been shown to be effective for training robots, but collecting such data is costly and time-consuming. This ch…
MimicDroid: In-Context Learning for Humanoid Robot Manipulation from Human Play Videos
Rutav Shah, Shuijing Liu, Qi Wang +5
We aim to enable humanoid robots to efficiently solve new manipulation tasks from a few video examples. In-context learning (ICL) is a promising framework for achieving this goal d…