Robust, Deep, and Reinforcement Learning for Management of Communication and Power Networks

Abstract

This thesis develops data-driven machine learning algorithms to managing and optimizing the next-generation highly complex cyberphysical systems, which desperately need ground-breaking control, monitoring, and decision making schemes that can guarantee robustness, scalability, and situational awareness. The present thesis first develops principled methods to make generic machine learning models robust against distributional uncertainties and adversarial data. Particular focus will be on parametric models where some training data are being used to learn a parametric model. The developed framework is of high interest especially when training and testing data are drawn from "slightly" different distribution. We then introduce distributionally robust learning frameworks to minimize the worst-case expected loss over a prescribed ambiguity set of training distributions quantified via Wasserstein distance. Later, we build on this robust framework to design robust semi-supervised learning over graph methods. The second part of this thesis aspires to fully unleash the potential of next-generation wired and wireless networks, where we design "smart" network entities using (deep) reinforcement learning approaches. Finally, this thesis enhances the power system operation and control. Our contribution is on sustainable distribution grids with high penetration of renewable sources and demand response programs. To account for unanticipated and rapidly changing renewable generation and load consumption scenarios, we specifically delegate reactive power compensation to both utility-owned control devices (e.g., capacitor banks), as well as smart inverters of distributed generation units with cyber-capabilities.

arXiv commentPhD thesis

References in corpus (18)

• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains
• Towards Deep Neural Network Architectures Robust to Adversarial Examples
• Optimal Geographic Caching In Cellular Networks
• Wireless Caching: Technical Misconceptions and Business Barriers
• Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
• Certifying Some Distributional Robustness with Principled Adversarial Training
• Convolutional Neural Network Architectures for Signals Supported on Graphs
• Context-Aware Proactive Content Caching with Service Differentiation in Wireless Networks
• Optimal and Scalable Caching for 5G Using Reinforcement Learning of Space-time Popularities
• Real-time Power System State Estimation and Forecasting via Deep Neural Networks
• A Learning-Based Approach to Caching in Heterogenous Small Cell Networks
• Placing Dynamic Content in Caches with Small Population
• Optimal Tap Setting of Voltage Regulation Transformers Using Batch Reinforcement Learning
• Online Censoring for Large-Scale Regressions with Application to Streaming Big Data
• Optimal Caching and Scheduling for Cache-enabled D2D Communications
• Two-Timescale Voltage Control in Distribution Grids Using Deep Reinforcement Learning
• Distributionally Robust Semi-Supervised Learning Over Graphs