The building thermodynamics model, which predicts real-time indoor temperature changes under potential HVAC (Heating, Ventilation, and Air Conditioning) control operations, is crucial for optimizing HVAC control in buildings. While pioneering studies have attempted to develop such models for various building environments, these models often require extensive data collection periods and rely heavily on expert knowledge, making the modeling process inefficient and limiting the reusability of the models. This paper explores a model ensemble perspective that utilizes existing developed models as base models to serve a target building environment, thereby providing accurate predictions while reducing the associated efforts. Given that building data streams are non-stationary and the number of base models may increase, we propose a Hierarchical Reinforcement Learning (HRL) approach to dynamically select and weight the base models. Our approach employs a two-tiered decision-making process: the high-level focuses on model selection, while the low-level determines the weights of the selected models. We thoroughly evaluate the proposed approach through offline experiments and an on-site case study, and the experimental results demonstrate the effectiveness of our method.
Comparative Field Deployment of Reinforcement Learning and Model Predictive Control for Residential HVAC
College of Engineering, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA 15213, USA;Wilton E. Scott Institute for Energy Innovation, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA 15213, USA;Center for High Performance Buildings, Purdue University, 177 S Russell St, West Lafayette, IN 47907, USA;Trane Technologies, Residential R\&D Group, 6200 Troup Hwy, Tyler, TX 75707, USA;Bosch Center for Artificial Intelligence
Data-driven HVAC Control Using Symbolic Regression: Design and Implementation
Graduate school of Information Science and Technology, Osaka University(大阪大学信息科学与技术研究院);Campus Sustainability Office, Osaka University(大阪大学校园可持续发展办公室);Graduate School of Engineering, Osaka University(大阪大学工学院)
Hierarchical Causal Abduction: A Foundation Framework for Explainable Model Predictive Control
System Dynamics, Chemnitz University of Technology, Chemnitz, Germany(化学特伦茨大学系统动力学系);Department of Bioresources, Fraunhofer Institute for Molecular Biology and Applied Ecology(弗劳恩霍夫分子生物学与应用生态学研究所生物资源系)