Learning Robotic Navigation from Experience: Principles, Methods, and Recent Results
arXiv:2212.06759 · doi:10.1098/rstb.2021.0447
Abstract
Navigation is one of the most heavily studied problems in robotics, and is conventionally approached as a geometric mapping and planning problem. However, real-world navigation presents a complex set of physical challenges that defies simple geometric abstractions. Machine learning offers a promising way to go beyond geometry and conventional planning, allowing for navigational systems that make decisions based on actual prior experience. Such systems can reason about traversability in ways that go beyond geometry, accounting for the physical outcomes of their actions and exploiting patterns in real-world environments. They can also improve as more data is collected, potentially providing a powerful network effect. In this article, we present a general toolkit for experiential learning of robotic navigation skills that unifies several recent approaches, describe the underlying design principles, summarize experimental results from several of our recent papers, and discuss open problems and directions for future work.
Final print version is here: https://royalsocietypublishing.org/doi/10.1098/rstb.2021.0447
References in corpus (13)
- On Calibration of Modern Neural Networks
- Conservative Q-Learning for Offline Reinforcement Learning
- Learning to Explore using Active Neural SLAM
- Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning
- Safe Robot Navigation via Multi-Modal Anomaly Detection
- ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints
- Search on the Replay Buffer: Bridging Planning and Reinforcement Learning
- Goal-Conditioned Reinforcement Learning with Imagined Subgoals
- Rapid Exploration for Open-World Navigation with Latent Goal Models
- To Go or Not To Go? A Near Unsupervised Learning Approach For Robot Navigation
- Rethinking Goal-conditioned Supervised Learning and Its Connection to Offline RL
- C-Learning: Learning to Achieve Goals via Recursive Classification
- Hierarchically Integrated Models: Learning to Navigate from Heterogeneous Robots