Building Safer Autonomous Agents by Leveraging Risky Driving Behavior Knowledge

Abstract

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under conservative interaction behavior amongst different vehicles. But, as we know, real driving tasks often involve very high risk scenarios where other drivers often don't behave in the expected sense. There can be many reasons for this behavior like being tired or inexperienced. The simulation environment doesn't take this information into account while training the navigation agent. Therefore, in this study we especially focus on systematically creating these risk prone scenarios with heavy traffic and unexpected random behavior for creating better model-free learning agents. We generate multiple autonomous driving scenarios by creating new custom Markov Decision Process (MDP) environment iterations in the highway-env simulation package. The behavior policy is learnt by agents trained with the help from deep reinforcement learning models. Our behavior policy is deliberated to handle collisions and risky randomized driver behavior. We train model free learning agents with supplement information of risk prone driving scenarios and compare their performance with baseline agents. Finally, we casually measure the impact of adding these perturbations in the training process to precisely account for the performance improvement obtained from utilizing the learnings from these scenarios.

arXiv commentPublished in CCCI 2021, Best Paper Award in Informatics

References in corpus (9)

• Playing Atari with Deep Reinforcement Learning
• Congested Traffic States in Empirical Observations and Microscopic Simulations
• Dueling Network Architectures for Deep Reinforcement Learning
• Safe, Multi-Agent, Reinforcement Learning for Autonomous Driving
• Distributionally Consistent Simulation of Naturalistic Driving Environment for Autonomous Vehicle Testing
• Approximate Robust Control of Uncertain Dynamical Systems
• Interval Prediction for Continuous-Time Systems with Parametric Uncertainties
• Budgeted Reinforcement Learning in Continuous State Space
• Corner Case Generation and Analysis for Safety Assessment of Autonomous Vehicles