A Review of Deep Reinforcement Learning for Smart Building Energy Management

Abstract

Global buildings account for about 30% of the total energy consumption and carbon emission, raising severe energy and environmental concerns. Therefore, it is significant and urgent to develop novel smart building energy management (SBEM) technologies for the advance of energy-efficient and green buildings. However, it is a nontrivial task due to the following challenges. Firstly, it is generally difficult to develop an explicit building thermal dynamics model that is both accurate and efficient enough for building control. Secondly, there are many uncertain system parameters (e.g., renewable generation output, outdoor temperature, and the number of occupants). Thirdly, there are many spatially and temporally coupled operational constraints. Fourthly, building energy optimization problems can not be solved in real-time by traditional methods when they have extremely large solution spaces. Fifthly, traditional building energy management methods have respective applicable premises, which means that they have low versatility when confronted with varying building environments. With the rapid development of Internet of Things technology and computation capability, artificial intelligence technology find its significant competence in control and optimization. As a general artificial intelligence technology, deep reinforcement learning (DRL) is promising to address the above challenges. Notably, the recent years have seen the surge of DRL for SBEM. However, there lacks a systematic overview of different DRL methods for SBEM. To fill the gap, this paper provides a comprehensive review of DRL for SBEM from the perspective of system scale. In particular, we identify the existing unresolved issues and point out possible future research directions.

21 pages, 12 figures

References in corpus (4)

• Rainbow: Combining Improvements in Deep Reinforcement Learning
• Transfer Learning in Deep Reinforcement Learning: A Survey
• A Survey of Deep Reinforcement Learning in Video Games
• One for Many: Transfer Learning for Building HVAC Control

Cited by in corpus (14)

• Federated Multi-Agent Deep Reinforcement Learning Approach via Physics-Informed Reward for Multi-Microgrid Energy Management
• An experimental evaluation of Deep Reinforcement Learning algorithms for HVAC control
• SINERGYM -- A virtual testbed for building energy optimization with Reinforcement Learning
• Physics-informed Modularized Neural Network for Advanced Building Control by Deep Reinforcement Learning
• Enhancing the Performance of Multi-Agent Reinforcement Learning for Controlling HVAC Systems
• Variational Quantum Circuit Design for Quantum Reinforcement Learning on Continuous Environments
• Recommender systems and reinforcement learning for human-building interaction and context-aware support: A text mining-driven review of scientific literature
• Low Emission Building Control with Zero-Shot Reinforcement Learning
• Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance
• Creation of AI-driven Smart Spaces for Enhanced Indoor Environments -- A Survey
• A Comparative Tutorial of Bayesian Sequential Design and Reinforcement Learning
• Conv-NILM-Net, a causal and multi-appliance model for energy source separation
• Optimal Operation of a Hydrogen-based Building Multi-Energy System Based on Deep Reinforcement Learning
• Does Explicit Prediction Matter in Deep Reinforcement Learning-Based Energy Management?