Modern commercial Heating, Ventilation, and Air Conditioning (HVAC) devices form a complex and interconnected thermodynamic system with the building and outside weather conditions, and current setpoint control policies are not fully optimized for minimizing energy use and carbon emission. Given a suitable training environment, a Reinforcement Learning (RL) model is able to improve upon these policies, but training such a model, especially in a way that scales to thousands of buildings, presents many real world challenges. We propose a novel simulation-based approach, where a customized simulator is used to train the agent for each building. Our open-source simulator (available online: https://github.com/google/sbsim) is lightweight and calibrated via telemetry from the building to reach a higher level of fidelity. On a two-story, 68,000 square foot building, with 127 devices, we were able to calibrate our simulator to have just over half a degree of drift from the real world over a six-hour interval. This approach is an important step toward having a real-world RL control system that can be scaled to many buildings, allowing for greater efficiency and resulting in reduced energy consumption and carbon emissions.
DLM: Unified Decision Language Models for Offline Multi-Agent Sequential Decision Making
Department of Control Science and Engineering, Tongji University, Shanghai 201804, China(同济大学控制科学与工程学院);Shanghai Institute of Intelligent Science and Technology(上海智能科学研究院);Shanghai Research Institute for Intelligent Autonomous Systems(上海智能自主系统研究院);State Key Laboratory of Autonomous Intelligent Unmanned Systems, Shanghai 200120, China(自主智能无人系统国家重点实验室)
How Much Online RL is Enough? Informative Rollouts for Offline Preference Optimization in RLVR
TCS Research Department of CSE(TCS计算机科学系研究部);IIT Madras(印度理工学院马德拉斯分校);Department of Data Science & AI(数据科学与人工智能系);Wadhwani School of Data Science & AI(Wadhwani数据科学与人工智能学院)
Automated Plant Disease and Pest Detection System Using Hybrid Lightweight CNN-MobileViT Models for Diagnosis of Indigenous Crops
Department of Computer Science \& Engineering;Department of Information Technology Mekelle University - Mekelle Institute of Technology, Ethiopia Email
Dual-stage and Lightweight Patient Chart Summarization for Emergency Physicians
Department of Electrical and Software Engineering, University of Calgary, Calgary, AB, Canada(电气与软件工程系,卡尔加里大学);Department of Emergency Medicine, University of Calgary, Calgary, AB, Canada(急诊医学系,卡尔加里大学);School of Information, University of Michigan, Ann Arbor, MI, USA(信息学院,密歇根大学);Rockview General Hospital, Calgary, AB, Canada(罗克维尔总医院)
SYN-DIGITS: A Synthetic Control Framework for Calibrated Digital Twin Simulation
Finance Division, Columbia Business School(哥伦比亚商学院金融系);Department of IEOR, Columbia University(哥伦比亚大学工业工程与运筹学系);Decision, Risk, and Operations Division, Columbia Business School(哥伦比亚商学院决策、风险与运营系);Department of IEOR and Data Science Institute, Columbia University(哥伦比亚大学工业工程与运筹学系和数据科学研究所)