Deep Deterministic Policy Gradient for Urban Traffic Light Control

Abstract

Traffic light timing optimization is still an active line of research despite the wealth of scientific literature on the topic, and the problem remains unsolved for any non-toy scenario. One of the key issues with traffic light optimization is the large scale of the input information that is available for the controlling agent, namely all the traffic data that is continually sampled by the traffic detectors that cover the urban network. This issue has in the past forced researchers to focus on agents that work on localized parts of the traffic network, typically on individual intersections, and to coordinate every individual agent in a multi-agent setup. In order to overcome the large scale of the available state information, we propose to rely on the ability of deep Learning approaches to handle large input spaces, in the form of Deep Deterministic Policy Gradient (DDPG) algorithm. We performed several experiments with a range of models, from the very simple one (one intersection) to the more complex one (a big city section).

References in corpus (5)

• Adam: A Method for Stochastic Optimization
• Continuous control with deep reinforcement learning
• Playing Atari with Deep Reinforcement Learning
• Trust Region Policy Optimization
• Using a Deep Reinforcement Learning Agent for Traffic Signal Control

Cited by in corpus (20)

• How to Build a Graph-Based Deep Learning Architecture in Traffic Domain: A Survey
• Large-Scale Traffic Signal Control Using a Novel Multi-Agent Reinforcement Learning
• A Survey on Traffic Signal Control Methods
• Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning
• UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control
• Diagnosing Reinforcement Learning for Traffic Signal Control
• Multi-hop RIS-Empowered Terahertz Communications: A DRL-based Hybrid Beamforming Design
• Precision medicine as a control problem: Using simulation and deep reinforcement learning to discover adaptive, personalized multi-cytokine therapy for sepsis
• An Open-Source Framework for Adaptive Traffic Signal Control
• A Deep Reinforcement Learning Approach for Traffic Signal Control Optimization
• Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning
• Optimizing city-scale traffic through modeling observations of vehicle movements
• Boosted Genetic Algorithm using Machine Learning for traffic control optimization
• Multi-Agent Deep Reinforcement Learning for Large-scale Traffic Signal Control
• Attacking Deep Reinforcement Learning-Based Traffic Signal Control Systems with Colluding Vehicles
• The Evolutionary Dynamics of Independent Learning Agents in Population Games
• Reinforcement Learning for Intelligent Healthcare Systems: A Comprehensive Survey
• Tensor-based Cooperative Control for Large Scale Multi-intersection Traffic Signal Using Deep Reinforcement Learning and Imitation Learning
• Hierarchical Robot Navigation in Novel Environments using Rough 2-D Maps
• Batch-Augmented Multi-Agent Reinforcement Learning for Efficient Traffic Signal Optimization