CoLight: Learning Network-level Cooperation for Traffic Signal Control

Abstract

Cooperation among the traffic signals enables vehicles to move through intersections more quickly. Conventional transportation approaches implement cooperation by pre-calculating the offsets between two intersections. Such pre-calculated offsets are not suitable for dynamic traffic environments. To enable cooperation of traffic signals, in this paper, we propose a model, CoLight, which uses graph attentional networks to facilitate communication. Specifically, for a target intersection in a network, CoLight can not only incorporate the temporal and spatial influences of neighboring intersections to the target intersection, but also build up index-free modeling of neighboring intersections. To the best of our knowledge, we are the first to use graph attentional networks in the setting of reinforcement learning for traffic signal control and to conduct experiments on the large-scale road network with hundreds of traffic signals. In experiments, we demonstrate that by learning the communication, the proposed model can achieve superior performance against the state-of-the-art methods.

10 pages. Proceedings of the 28th ACM International on Conference on Information and Knowledge Management. ACM, 2018

References in corpus (1)

• CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario

Cited by in corpus (22)

• Flow: A Modular Learning Framework for Mixed Autonomy Traffic
• Network-wide traffic signal control optimization using a multi-agent deep reinforcement learning
• IG-RL: Inductive Graph Reinforcement Learning for Massive-Scale Traffic Signal Control
• Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning
• EMVLight: a Multi-agent Reinforcement Learning Framework for an Emergency Vehicle Decentralized Routing and Traffic Signal Control System
• The Internet of Federated Things (IoFT): A Vision for the Future and In-depth Survey of Data-driven Approaches for Federated Learning
• Unified Automatic Control of Vehicular Systems with Reinforcement Learning
• GeneraLight: Improving Environment Generalization of Traffic Signal Control via Meta Reinforcement Learning
• LibSignal: An Open Library for Traffic Signal Control
• DynSTGAT: Dynamic Spatial-Temporal Graph Attention Network for Traffic Signal Control
• Multi-Agent Reinforcement Learning Based on Representational Communication for Large-Scale Traffic Signal Control
• Open-TI: Open Traffic Intelligence with Augmented Language Model
• Towards Multi-agent Reinforcement Learning based Traffic Signal Control through Spatio-temporal Hypergraphs
• Reinforcement Learning for Mixed Autonomy Intersections
• Reinforcement Learning Approaches for Traffic Signal Control under Missing Data
• Urban Computing in the Era of Large Language Models
• Traffic Signal Cycle Control with Centralized Critic and Decentralized Actors under Varying Intervention Frequencies
• Learning Traffic Signal Control via Genetic Programming
• Large-scale traffic signal control using machine learning: some traffic flow considerations
• MARLens: Understanding Multi-agent Reinforcement Learning for Traffic Signal Control via Visual Analytics
• Dealing with Sparse Rewards Using Graph Neural Networks
• A Payne-Whitham model of urban traffic networks in the presence of traffic lights and its application to traffic optimisation