Rapid Exploration for Open-World Navigation with Latent Goal Models
arXiv:2104.05859
Abstract
We describe a robotic learning system for autonomous exploration and navigation in diverse, open-world environments. At the core of our method is a learned latent variable model of distances and actions, along with a non-parametric topological memory of images. We use an information bottleneck to regularize the learned policy, giving us (i) a compact visual representation of goals, (ii) improved generalization capabilities, and (iii) a mechanism for sampling feasible goals for exploration. Trained on a large offline dataset of prior experience, the model acquires a representation of visual goals that is robust to task-irrelevant distractors. We demonstrate our method on a mobile ground robot in open-world exploration scenarios. Given an image of a goal that is up to 80 meters away, our method leverages its representation to explore and discover the goal in under 20 minutes, even amidst previously-unseen obstacles and weather conditions. Please check out the project website for videos of our experiments and information about the real-world dataset used at https://sites.google.com/view/recon-robot.
Presented at 5th Annual Conference on Robot Learning (CoRL 2021), London, UK as an Oral Talk. Project page and dataset release at https://sites.google.com/view/recon-robot
Cited by in corpus (4)
- ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints
- Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results
- ESceme: Vision-and-Language Navigation with Episodic Scene Memory
- Hybrid Imitative Planning with Geometric and Predictive Costs in Off-road Environments