Anti-Jerk On-Ramp Merging Using Deep Reinforcement Learning
arXiv:1909.12967
Abstract
Deep Reinforcement Learning (DRL) is used here for decentralized decision-making and longitudinal control for high-speed on-ramp merging. The DRL environment state includes the states of five vehicles: the merging vehicle, along with two preceding and two following vehicles when the merging vehicle is or is projected on the main road. The control action is the acceleration of the merging vehicle. Deep Deterministic Policy Gradient (DDPG) is the DRL algorithm for training to output continuous control actions. We investigated the relationship between collision avoidance for safety and jerk minimization for passenger comfort in the multi-objective reward function by obtaining the Pareto front. We found that, with a small jerk penalty in the multi-objective reward function, the vehicle jerk could be reduced by 73% compared with no jerk penalty while the collision rate was maintained at zero. Regardless of the jerk penalty, the merging vehicle exhibited decision-making strategies such as merging ahead or behind a main-road vehicle.
Accepted to 2020 IEEE Intelligent Vehicles Symposium
References in corpus (8)
- Continuous control with deep reinforcement learning
- Congested Traffic States in Empirical Observations and Microscopic Simulations
- Comparison of Deep Reinforcement Learning and Model Predictive Control for Adaptive Cruise Control
- Freeway Merging in Congested Traffic based on Multipolicy Decision Making with Passive Actor Critic
- Longitudinal Dynamic versus Kinematic Models for Car-Following Control Using Deep Reinforcement Learning
- Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space
- Agent-Based Modeling and Simulation of Connected and Automated Vehicles Using Game Engine: A Cooperative On-Ramp Merging Study
- Interaction-aware Decision Making with Adaptive Strategies under Merging Scenarios