Mobile Robot Exploration Without Maps via Out-of-Distribution Deep Reinforcement Learning

Abstract

Autonomous Mobile Robot (AMR) navigation in dynamic environments that may be GPS denied, without a-priori maps, is an unsolved problem with potential to improve humanity's capabilities. Conventional modular methods are computationally inefficient, and require explicit feature extraction and engineering that inhibit generalization and deployment at scale. We present an Out-of-Distribution (OOD) Deep Reinforcement Learning (DRL) approach that includes functionality in unstructured terrain and dynamic obstacle avoidance capabilities. We leverage accelerated simulation training in a racetrack with a transition probability to parameterize spatial reasoning with intrinsic exploratory behavior, in a compact, computationally efficient Artificial Neural Network (ANN), which we transfer zero-shot with a reward component to mitigate differences between simulation and real world physics. Our approach enables utility without a separate high-level planner or real-time cartography and utilizes a fraction of the computation resources of modular methods, enabling execution in a range of AMRs with different embedded computer payloads.

arXiv comment\c{opyright} 2025 the authors. This work has been accepted to IFAC for publication under a Creative Commons License CC-BY-NC-ND

References in corpus (5)

• Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age
• Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model
• Reaching the Limit in Autonomous Racing: Optimal Control versus Reinforcement Learning
• Competitive Driving of Autonomous Vehicles
• Deep Reinforcement Learning for Autonomous Ground Vehicle Exploration Without A-Priori Maps