Deep Reinforcement Learning for Smart Home Energy Management

Abstract

In this paper, we investigate an energy cost minimization problem for a smart home in the absence of a building thermal dynamics model with the consideration of a comfortable temperature range. Due to the existence of model uncertainty, parameter uncertainty (e.g., renewable generation output, non-shiftable power demand, outdoor temperature, and electricity price) and temporally-coupled operational constraints, it is very challenging to determine the optimal energy management strategy for scheduling Heating, Ventilation, and Air Conditioning (HVAC) systems and energy storage systems in the smart home. To address the challenge, we first formulate the above problem as a Markov decision process, and then propose an energy management strategy based on Deep Deterministic Policy Gradients (DDPG). It is worth mentioning that the proposed strategy does not require the prior knowledge of uncertain parameters and building thermal dynamics model. Simulation results based on real-world traces demonstrate the effectiveness and robustness of the proposed strategy.

15 pages, 16 figures

References in corpus (5)

• Continuous control with deep reinforcement learning
• Robust Energy Management for Microgrids With High-Penetration Renewables
• Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning
• Arbitrage of Energy Storage in Electricity Markets with Deep Reinforcement Learning
• Non-Markovian Control with Gated End-to-End Memory Policy Networks

Cited by in corpus (17)

• A Review of Deep Reinforcement Learning for Smart Building Energy Management
• Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges
• An optimal home energy management system for modulating heat pumps and photovoltaic systems
• Renewable energy management in smart home environment via forecast embedded scheduling based on Recurrent Trend Predictive Neural Network
• MILP-based Imitation Learning for HVAC control
• Correlated Deep Q-learning based Microgrid Energy Management
• TreeC: a method to generate interpretable energy management systems using a metaheuristic algorithm
• Contingency-constrained economic dispatch with safe reinforcement learning
• Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings
• Scalable Multi-Agent Reinforcement Learning for Residential Load Scheduling under Data Governance
• On the Optimality of Procrastination Policy for EV charging under Net Energy Metering
• Online Learning of Interconnected Neural Networks for Optimal Control of an HVAC System
• Optimal Operation of a Hydrogen-based Building Multi-Energy System Based on Deep Reinforcement Learning
• Sequential Operation of Residential Energy Hubs using Physics-Based Economic Nonlinear MPC
• A Supervised-Learning based Hour-Ahead Demand Response of a Behavior-based HEMS approximating MILP Optimization
• Does Explicit Prediction Matter in Deep Reinforcement Learning-Based Energy Management?
• Supervised Reinforcement Learning for the Coordination of Distributed Energy Resources