384 citations · 1.5k across the 50 of their papers we have counts for
12 papers · 1 filter
Holo-Dex: Teaching Dexterity with Immersive Mixed Reality
Sridhar Pandian Arunachalam, Irmak Güzey, Soumith Chintala +1
A fundamental challenge in teaching robots is to provide an effective interface for human teachers to demonstrate useful skills to a robot. This challenge is exacerbated in dextero…
That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation
Abitha Thankaraj, Lerrel Pinto
Learning to produce contact-rich, dynamic behaviors from raw sensory data has been a longstanding challenge in robotics. Prominent approaches primarily focus on using visual or tac…
From Play to Policy: Conditional Behavior Generation from Uncurated Robot Data
Zichen Jeff Cui, Yibin Wang, Nur Muhammad Mahi Shafiullah +1
While large-scale sequence modeling from offline data has led to impressive performance gains in natural language and image generation, directly translating such ideas to robotics…
CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory
Nur Muhammad Mahi Shafiullah, Chris Paxton, Lerrel Pinto +2
We propose CLIP-Fields, an implicit scene model that can be used for a variety of tasks, such as segmentation, instance identification, semantic search over space, and view localiz…
Human Decision Makings on Curriculum Reinforcement Learning with Difficulty Adjustment
Yilei Zeng, Jiali Duan, Yang Li +4
Human-centered AI considers human experiences with AI performance. While abundant research has been helping AI achieve superhuman performance either by fully automatic or weak supe…
Watch and Match: Supercharging Imitation with Regularized Optimal Transport
Siddhant Haldar, Vaibhav Mathur, Denis Yarats +1
Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforceme…