论文标题
使用加固学习控制商业冷却系统
Controlling Commercial Cooling Systems Using Reinforcement Learning
论文作者
论文摘要
本文是DeepMind和Google最近在控制商业冷却系统的强化学习方面的技术概述。在专业知识的基础上,从更有效地冷却Google的数据中心开始,我们最近与建筑管理系统提供商Trane Technologies合作,在两个现实世界中进行了实时实验。这些实验实验在评估,从离线数据中学习和约束满意度等领域面临着各种挑战。我们的论文描述了这些挑战,希望对它们的认识将使未来应用的RL工作有利。我们还描述了我们调整RL系统以应对这些挑战的方式,从而在两个实时实验站点中分别节省了大约9%和13%的能源。
This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently conducted live experiments on two real-world facilities in partnership with Trane Technologies, a building management system provider. These live experiments had a variety of challenges in areas such as evaluation, learning from offline data, and constraint satisfaction. Our paper describes these challenges in the hope that awareness of them will benefit future applied RL work. We also describe the way we adapted our RL system to deal with these challenges, resulting in energy savings of approximately 9% and 13% respectively at the two live experiment sites.