Adaptive Power System Emergency Control using Deep Reinforcement Learning

Abstract

Power system emergency control is generally regarded as the last safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived "worst" case scenario or a few typical operation scenarios. These schemes are facing significant adaptiveness and robustness issues as increasing uncertainties and variations occur in modern electrical grids. To address these challenges, for the first time, this paper developed novel adaptive emergency control schemes using deep reinforcement learning (DRL), by leveraging the high-dimensional feature extraction and non-linear generalization capabilities of DRL for complex power systems. Furthermore, an open-source platform named RLGC has been designed for the first time to assist the development and benchmarking of DRL algorithms for power system control. Details of the platform and DRL-based emergency control schemes for generator dynamic braking and under-voltage load shedding are presented. Extensive case studies performed in both two-area four-machine system and IEEE 39-Bus system have demonstrated the excellent performance and robustness of the proposed schemes.

12 pages

References in corpus (6)

• Deep Reinforcement Learning that Matters
• Safe Exploration in Continuous Action Spaces
• Sim-to-Real: Learning Agile Locomotion For Quadruped Robots
• Deep Reinforcement Learning for Robotic Manipulation-The state of the art
• InterPSS: A New Generation Power System Simulation Engine
• Fast and Robust Determination of Power System Emergency Control Actions