Learning Autonomous Race Driving with Action Mapping Reinforcement Learning

Abstract

Autonomous race driving poses a complex control challenge as vehicles must be operated at the edge of their handling limits to reduce lap times while respecting physical and safety constraints. This paper presents a novel reinforcement learning (RL)-based approach, incorporating the action mapping (AM) mechanism to manage state-dependent input constraints arising from limited tire-road friction. A numerical approximation method is proposed to implement AM, addressing the complex dynamics associated with the friction constraints. The AM mechanism also allows the learned driving policy to be generalized to different friction conditions. Experimental results in our developed race simulator demonstrate that the proposed AM-RL approach achieves superior lap times and better success rates compared to the conventional RL-based approaches. The generalization capability of driving policy with AM is also validated in the experiments.

References in corpus (11)

• A Survey of Autonomous Driving: Common Practices and Emerging Technologies
• A Survey of Deep Learning Techniques for Autonomous Driving
• Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
• Lidar for Autonomous Driving: The principles, challenges, and trends for automotive lidar and perception systems
• Control of a Quadrotor with Reinforcement Learning
• Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveys
• Safe Exploration in Continuous Action Spaces
• Reward Constrained Policy Optimization
• Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning
• Real-Time Control for Autonomous Racing Based on Viability Theory
• Aggressive Deep Driving: Model Predictive Control with a CNN Cost Model