Flow Rate Control in Smart District Heating Systems Using Deep Reinforcement Learning

Abstract

At high latitudes, many cities adopt a centralized heating system to improve the energy generation efficiency and to reduce pollution. In multi-tier systems, so-called district heating, there are a few efficient approaches for the flow rate control during the heating process. In this paper, we describe the theoretical methods to solve this problem by deep reinforcement learning and propose a cloud-based heating control system for implementation. A real-world case study shows the effectiveness and practicability of the proposed system controlled by humans, and the simulated experiments for deep reinforcement learning show about 1985.01 gigajoules of heat quantity and 42276.45 tons of water are saved per hour compared with manual control.

Submitted to Information Processing in Sensor Networks (IPSN 2020)

References in corpus (3)

• Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
• Leveraging Demonstrations for Deep Reinforcement Learning on Robotics Problems with Sparse Rewards
• Composing Meta-Policies for Autonomous Driving Using Hierarchical Deep Reinforcement Learning

Cited by in corpus (4)

• A review on deep reinforcement learning for fluid mechanics: an update
• A review on Deep Reinforcement Learning for Fluid Mechanics
• Towards Optimal District Heating Temperature Control in China with Deep Reinforcement Learning
• Deep reinforcement learning for the control of conjugate heat transfer with application to workpiece cooling