Graph Reinforcement Learning for Power Grids: A Comprehensive Survey

Abstract

The increasing share of renewable energy and distributed electricity generation requires the development of deep learning approaches to address the lack of flexibility inherent in traditional power grid methods. In this context, Graph Neural Networks are a promising solution due to their ability to learn from graph-structured data. Combined with Reinforcement Learning, they can be used as control approaches to determine remedial actions. This review analyses how Graph Reinforcement Learning can improve representation learning and decision-making in power grid applications, particularly transmission and distribution grids. We analyze the reviewed approaches in terms of the graph structure, the Graph Neural Network architecture, and the Reinforcement Learning approach. Although Graph Reinforcement Learning has demonstrated adaptability to unpredictable events and noisy data, its current stage is primarily proof-of-concept, and it is not yet deployable to real-world applications. We highlight the open challenges and limitations for real-world applications.

Accepted in Energy & AI, in-press

References in corpus (13)

• A Comprehensive Survey on Graph Neural Networks
• A Brief Survey of Deep Reinforcement Learning
• Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model
• pandapower - an Open Source Python Tool for Convenient Modeling, Analysis and Optimization of Electric Power Systems
• Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A survey
• Convex Restriction of Power Flow Feasibility Sets
• Review of Steady-State Electric Power Distribution System Datasets
• Toward Dynamic Stability Assessment of Power Grid Topologies using Graph Neural Networks
• Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents
• A Reinforcement Learning Approach for the Continuous Electricity Market of Germany: Trading from the Perspective of a Wind Park Operator
• Power to the Relational Inductive Bias: Graph Neural Networks in Electrical Power Grids
• HUGO -- Highlighting Unseen Grid Options: Combining Deep Reinforcement Learning with a Heuristic Target Topology Approach
• Learning Topology Actions for Power Grid Control: A Graph-Based Soft-Label Imitation Learning Approach