A Survey on Autonomous Vehicle Control in the Era of Mixed-Autonomy: From Physics-Based to AI-Guided Driving Policy Learning
arXiv:2007.05156
Abstract
This paper serves as an introduction and overview of the potentially useful models and methodologies from artificial intelligence (AI) into the field of transportation engineering for autonomous vehicle (AV) control in the era of mixed autonomy. We will discuss state-of-the-art applications of AI-guided methods, identify opportunities and obstacles, raise open questions, and help suggest the building blocks and areas where AI could play a role in mixed autonomy. We divide the stage of autonomous vehicle (AV) deployment into four phases: the pure HVs, the HV-dominated, the AVdominated, and the pure AVs. This paper is primarily focused on the latter three phases. It is the first-of-its-kind survey paper to comprehensively review literature in both transportation engineering and AI for mixed traffic modeling. Models used for each phase are summarized, encompassing game theory, deep (reinforcement) learning, and imitation learning. While reviewing the methodologies, we primarily focus on the following research questions: (1) What scalable driving policies are to control a large number of AVs in mixed traffic comprised of human drivers and uncontrollable AVs? (2) How do we estimate human driver behaviors? (3) How should the driving behavior of uncontrollable AVs be modeled in the environment? (4) How are the interactions between human drivers and autonomous vehicles characterized? Hopefully this paper will not only inspire our transportation community to rethink the conventional models that are developed in the data-shortage era, but also reach out to other disciplines, in particular robotics and machine learning, to join forces towards creating a safe and efficient mixed traffic ecosystem.
References in corpus (30)
- Continuous control with deep reinforcement learning
- Congested Traffic States in Empirical Observations and Microscopic Simulations
- End to End Learning for Self-Driving Cars
- Trust Region Policy Optimization
- A Survey of Deep Learning Techniques for Autonomous Driving
- High-Dimensional Continuous Control Using Generalized Advantage Estimation
- Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equations
- Learning to Communicate with Deep Multi-Agent Reinforcement Learning
- Dissipation of stop-and-go waves via control of autonomous vehicles: Field experiments
- Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
- Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving
- Mistuning-based Control Design to Improve Closed-Loop Stability of Vehicular Platoons
- Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Car
- Memory-based control with recurrent neural networks
- Multi-Agent Generative Adversarial Imitation Learning
- ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst
- End-to-End Deep Learning for Steering Autonomous Vehicles Considering Temporal Dependencies
- An LSTM-Based Autonomous Driving Model Using Waymo Open Dataset
- Waymo Driverless Car Data Analysis and Driving Modeling using CNN and LSTM
- A Game-Theoretic Framework for Autonomous Vehicles Velocity Control: Bridging Microscopic Differential Games and Macroscopic Mean Field Games
- Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety
- Goal-Driven Dynamics Learning via Bayesian Optimization
- Reinforcement Learning with Probabilistic Guarantees for Autonomous Driving
- The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenes
- Combining Neural Networks and Tree Search for Task and Motion Planning in Challenging Environments
- Batch Active Preference-Based Learning of Reward Functions
- Game-theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validation
- Stabilizing Traffic via Autonomous Vehicles: A Continuum Mean Field Game Approach
- A*3D Dataset: Towards Autonomous Driving in Challenging Environments
- A Game-Theoretic Model of Human Driving and Application to Discretionary Lane-Changes