Learning to Navigate Sidewalks in Outdoor Environments

Abstract

Outdoor navigation on sidewalks in urban environments is the key technology behind important human assistive applications, such as last-mile delivery or neighborhood patrol. This paper aims to develop a quadruped robot that follows a route plan generated by public map services, while remaining on sidewalks and avoiding collisions with obstacles and pedestrians. We devise a two-staged learning framework, which first trains a teacher agent in an abstract world with privileged ground-truth information, and then applies Behavior Cloning to teach the skills to a student agent who only has access to realistic sensors. The main research effort of this paper focuses on overcoming challenges when deploying the student policy on a quadruped robot in the real world. We propose methodologies for designing sensing modalities, network architectures, and training procedures to enable zero-shot policy transfer to unstructured and dynamic real outdoor environments. We evaluate our learning framework on a quadrupedal robot navigating sidewalks in the city of Atlanta, USA. Using the learned navigation policy and its onboard sensors, the robot is able to walk 3.2 kilometers with a limited number of human interventions.

arXiv commentSubmitted to IEEE Robotics and Automation Letters (RA-L)

References in corpus (8)

• Soft Actor-Critic Algorithms and Applications
• Reinforcement Learning with Augmented Data
• Learning to Explore using Active Neural SLAM
• iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenes
• DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames
• Sample Factory: Egocentric 3D Control from Pixels at 100000 FPS with Asynchronous Reinforcement Learning
• Observation Space Matters: Benchmark and Optimization Algorithm
• Megaverse: Simulating Embodied Agents at One Million Experiences per Second