One for Many: Transfer Learning for Building HVAC Control

Abstract

The design of building heating, ventilation, and air conditioning (HVAC) system is critically important, as it accounts for around half of building energy consumption and directly affects occupant comfort, productivity, and health. Traditional HVAC control methods are typically based on creating explicit physical models for building thermal dynamics, which often require significant effort to develop and are difficult to achieve sufficient accuracy and efficiency for runtime building control and scalability for field implementations. Recently, deep reinforcement learning (DRL) has emerged as a promising data-driven method that provides good control performance without analyzing physical models at runtime. However, a major challenge to DRL (and many other data-driven learning methods) is the long training time it takes to reach the desired performance. In this work, we present a novel transfer learning based approach to overcome this challenge. Our approach can effectively transfer a DRL-based HVAC controller trained for the source building to a controller for the target building with minimal effort and improved performance, by decomposing the design of neural network controller into a transferable front-end network that captures building-agnostic behavior and a back-end network that can be efficiently trained for each specific building. We conducted experiments on a variety of transfer scenarios between buildings with different sizes, numbers of thermal zones, materials and layouts, air conditioner types, and ambient weather conditions. The experimental results demonstrated the effectiveness of our approach in significantly reducing the training time, energy cost, and temperature violations.

arXiv commentBuildsys 2020 Accepted

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• Solving Rubik's Cube with a Robot Hand
• Deep Q-learning from Demonstrations
• Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learning
• Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning
• Online Transfer Learning in Reinforcement Learning Domains
• Distributed Control of Multi-zone HVAC Systems Considering Indoor Air Quality

Cited by in corpus (5)

• A Review of Deep Reinforcement Learning for Smart Building Energy Management
• An experimental evaluation of Deep Reinforcement Learning algorithms for HVAC control
• Data-driven control of room temperature and bidirectional EV charging using deep reinforcement learning: simulations and experiments
• Cocktail: Learn a Better Neural Network Controller from Multiple Experts via Adaptive Mixing and Robust Distillation
• Learning-based Framework for Sensor Fault-Tolerant Building HVAC Control with Model-assisted Learning