Learning-based Model Predictive Control for Smart Building Thermal Management
Virginia Commonwealth University（弗吉尼亚联邦大学）
Roja Eini, Sherif Abdelwahed
备注：
5 pages, 9 figures, conference paper, accepted in the 16th International Conference on Smart Cities: Improving Quality of Life Using ICT & IoT (HONET-ICT)
This paper proposes a learning-based model predictive control (MPC) approach for the thermal control of a four-zone smart building. The objectives are to minimize energy consumption and maintain the residents' comfort. The proposed control scheme incorporates learning with the model-based control. The occupancy profile in the building zones are estimated in a long-term horizon through the artificial neural network (ANN), and this data is fed into the model-based predictor to get the indoor temperature predictions. The Energy Plus software is utilized as the actual dataset provider (weather data, indoor temperature, energy consumption). The optimization problem, including the actual and predicted data, is solved in each step of the simulation and the input setpoint temperature for the heating/cooling system, is generated. Comparing the results of the proposed approach with the conventional MPC results proved the significantly better performance of the proposed method in energy savings (40.56% less cooling power consumption and 16.73% less heating power consumption), and residents' comfort.
A novel smart metering technique capable of anomaly detection was proposed for real-time home power management system. Smart meter data generated in real-time was obtained from 900 households of single apartments. To detect outliers and missing values in smart meter data, a deep learning model, the autoencoder, consisting of a graph convolutional network and bidirectional long short-term memory network, was applied to the smart metering technique. Power management based on the smart metering technique was performed by multi-objective optimization in the presence of a battery storage system and…
With the booming of smart grid, The ubiquitously deployed smart meters constitutes an energy internet of things. This paper develops a novel blockchain-based transactive energy management system for IoT-aided smart homes. We consider a holistic set of options for smart homes to participate in transactive energy. Smart homes can interact with the grid to perform vertical transactions, e.g., feeding in extra solar energy to the grid and providing demand response service to alleviate the grid load. Smart homes can also interact with peer users to perform horizontal transactions, e.g., peer-to-pee…
The paper proposes an optimal management strategy for a Smart Port equipped with renewable generation and composed by an electrified quay, operating Cold-Ironing, and a Hydrogen-based quay, supplying Zero-Emission Ships. One Battery Energy Storage System and one Hydrogen Energy Storage System are used to manage renewable energy sources and to supply electric and hydrogen-fueled ships. A model predictive control based algorithm is designed to define the best economic strategy to be followed during operations. The control algorithm takes into account the uncertainties of renewable energy generat…
Nowadays the emerging smart grid technology opens up the possibility of two-way communication between customers and energy utilities. Demand Response Management (DRM) offers the promise of saving money for commercial customers and households while helps utilities operate more efficiently. In this paper, an Incentive-based Demand Response Optimization (IDRO) model is proposed to efficiently schedule household appliances for minimum usage during peak hours. The proposed method is a multi-objective optimization technique based on Nonlinear Auto-Regressive Neural Network (NAR-NN) which considers e…
We discovered a deficiency in Algorithm 1 and Theorem 3 of [1]. The algorithm called CEMA aims to solve an energy management problem distributively. However, by means of a counter example, we show that Theorem 2 and 3 of [1] contradict each other in the case of a valid scenario, proving that the suggested algorithm does not always find the optimum. Furthermore, we provide theoretic results, showing that Theorem 3 of [1] does not hold generally. At last, we provide a rectification by adjusting the algorithm and the corresponding proof of Theorem 3.
University of Central Florida（中佛罗里达大学）；University of Ottawa（渥太华大学）
A smart home energy management system (HEMS) can contribute towards reducing the energy costs of customers; however, HEMS suffers from uncertainty in both energy generation and consumption patterns. In this paper, we propose a sequence to sequence (Seq2Seq) learning-based supply and load prediction along with reinforcement learning-based HEMS control. We investigate how the prediction method affects the HEMS operation. First, we use Seq2Seq learning to predict photovoltaic (PV) power and home devices' load. We then apply Q-learning for offline optimization of HEMS based on the prediction resul…
Demand side management (DSM) is one of the main functionalities of the smart grid as it allows the consumer to adjust its energy consumption for an efficient energy management. Most of the existing DSM techniques aim at minimizing the energy cost while not considering the comfort of consumers. Therefore, maintaining a trade-off between these two conflicting objectives is still a challenging task. This paper proposes a novel DSM approach for residential consumers based on a non-cooperative game theoretic approach, where each player is encouraged to reshape its electricity consumption pattern th…
In this paper, we investigate an energy cost minimization problem for a smart home in the absence of a building thermal dynamics model with the consideration of a comfortable temperature range. Due to the existence of model uncertainty, parameter uncertainty (e.g., renewable generation output, non-shiftable power demand, outdoor temperature, and electricity price) and temporally-coupled operational constraints, it is very challenging to determine the optimal energy management strategy for scheduling Heating, Ventilation, and Air Conditioning (HVAC) systems and energy storage systems in the sma…
This work presents the design and implementation of a blockchain system that enables the trustable transactive energy management for distributed energy resources (DERs). We model the interactions among DERs, including energy trading and flexible appliance scheduling, as a cost minimization problem. Considering the dispersed nature and diverse ownership of DERs, we develop a distributed algorithm to solve the optimization problem using the alternating direction method of multipliers (ADMM) method. Furthermore, we develop a blockchain system, on which we implement the proposed algorithm with the…
Electricity usage is a major portion of utility bills and the best place to start lowering them. An effective home energy management approach is introduced to decrease customers' electricity bills by determining the optimal appliance scheduling under hourly pricing based demand response (DR) strategies. The proposed approach specifically addresses consumer comfort through acceptable appliance deferral times, within which their consumption can be shifted from the normal schedules. Electric vehicles (EVs), with vehicle to grid (V2G) and vehicle-to-home (V2H) abilities, Energy storage systems (ES…
Intelligent Energy Management with IoT Framework in Smart Cities Using Intelligent Analysis: An Application of Machine Learning Methods for Complex Networks and Systems
Islamic Azad University（伊斯兰阿扎德大学）；Khaje Nasirodin Toos (K.N.Toosi) University of Technology（霍贾·纳西罗丁·图斯（K.N.图斯）理工大学）；Shiraz University（设拉子大学）；Florida Atlantic University（佛罗里达大西洋大学）；The University of Alabama（阿拉巴马大学）；The University of Texas at Arlington（德克萨斯大学阿灵顿分校）；University of Alabama（阿拉巴马大学）
University of Kansas（堪萨斯大学）；Amazon Web Services（亚马逊云科技）
This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users. DR has a widely recognized potential for improving power grid stability and reliability, while at the same time reducing end-users energy bills. However, the conventional DR techniques come with several shortcomings, such as the inability to handle operational uncertainties whi…
An Interoperable Realization of Smart Cities with Plug and Play based Device Management
Robert Bosch Centre for Cyber Physical Systems, Indian Institute of Science（印度科学学院）；Supercomputing Education and Research Centre, Indian Institute of Science（印度科学学院）
This paper presents a multi-agent control architecture and an online optimization method based on dynamic average consensus to coordinate the power consumption of a large population of Thermostatically Controlled Loads (TCLs). Our objective is to penalize peaks of power demand, smooth the load profile and enable Demand Side Management (DSM). The proposed architecture and methods exploit only local measurements of power consumption via Smart Power Sockets (SPSs) with no access to their internal temperature. No centralized aggregator of information is exploited and agents preserve their privacy …
Management of Renewable Energy for A Shared Facility Controller in Smart Grid
Singapore University of Technology and Design（新加坡科技设计大学）；University of Technology Sydney（悉尼科技大学）；Data61 (NICTA), CSIRO（数据六十一（国家信息技术中心），联邦科学与工业研究组织）；Australian National University (ANU)（澳大利亚国立大学）；Lahore University of Management Sciences（拉合尔管理科学大学）
In current Medium Voltage DC (MVDC) Shipboard Power Systems (SPSs), multiple sources exist to supply power to a common dc bus. Conventionally, the power management of such systems is performed by controlling Power Generation Modules (PGMs) which include fuel operated generators and underlying converters. Moreover, energy management is performed by the emerging single or hybrid Energy Storage Systems (ESSs). This paper presents a model and load predictive control framework for power and energy management of SPSs. Here, MPC with load prediction is used for three main objectives: (1) to request p…
This paper investigates the problem of energy-optimal control for autonomous underwater vehicles (AUVs). To improve the endurance of AUVs, we propose a novel energy-optimal control scheme based on the economic model predictive control (MPC) framework. We first formulate a cost function that computes the energy spent for vehicle operation over a finite-time prediction horizon. Then, to account for the energy consumption beyond the prediction horizon, a terminal cost that approximates the energy to reach the goal (energy-to-go) is incorporated into the MPC cost function.
As Internet of Things (IoT) technologies enable greater communication between energy assets in smart cities, the operational coordination of various energy networks in a city or district becomes more viable. Suitable tools are needed that can harness advanced control and machine learning techniques to achieve environmental, economic and resilience objectives. In this paper, an energy management tool is presented that can offer optimal control, scheduling, forecasting and coordination services to energy assets across a district, enabling optimal decisions under user-defined objectives. The tool…
The cost of the power distribution infrastructures is driven by the peak power encountered in the system. Therefore, the distribution network operators consider billing consumers behind a common transformer in the function of their peak demand and leave it to the consumers to manage their collective costs. This management problem is, however, not trivial. In this paper, we consider a multi-agent residential smart grid system, where each agent has local renewable energy production and energy storage, and all agents are connected to a local transformer. The objective is to develop an optimal pol…
Smart grid (SG) systems enhance grid resilience and efficient operation, leveraging the bidirectional flow of energy and information between generation facilities and prosumers. For energy demand management (EDM), the SG network requires computing a large amount of data generated by massive Internet-of-things sensors and advanced metering infrastructure (AMI) with minimal latency. This paper proposes a deep reinforcement learning (DRL)-based resource allocation scheme in a 6G-enabled SG edge network to offload resource-consuming EDM computation to edge servers. Automatic resource provisioning …
In concept, a smart charging management system (SCMS) optimizes the charging of plug-in vehicles (PEVs) and provides various grid services including voltage control, frequency regulation, peak shaving, renewable energy integration support, spinning reserve, and emergency demand response. These functionalities largely depend upon data collected from various entities such as PEVs, electric vehicle supply equipment (EVSE), service providers, and utilities. SCMS can be susceptible to both cyber and physical threats (e.g. man-in-the-middle attack, data intrigued attack, denial of charging, physical…
Network-Realised Model Predictive Control Part II: Distributed Constraint Management
Department of Automatic Control；Systems Engineering, ``Politehnica'' University of Bucharest, Bucharest, Romania -1mm；Laboratoire des Signaux et Syst\`emes, CentraleSup\'elec, Paris-Saclay University, Gif-sur-Yvette, France -9mm
Smart Grid Testbed for Demand Focused Energy Management in End User Environments
Singapore University of Technology and Design（新加坡科技设计大学）；State Grid Global Energy Interconnection Research Institute（国家电网全球能源互联网研究院）；Ministry of Home Affairs（内政部）；Power Automation（电力自动化）；Zhejiang University（浙江大学）
Energy Management for a User Interactive Smart Community: A Stackelberg Game Approach
Singapore University of Technology and Design（新加坡科技设计大学）；State Key Lab. of Industrial Control Technology, Zhejiang University（浙江大学工业控制技术国家重点实验室）；NICTA（澳大利亚国家信息与通信技术学院）；School of Engineering and Applied Science, Princeton University（普林斯顿大学工程与应用科学学院）
Building energy management is one of the core problems in modern power grids to reduce energy consumption while ensuring occupants' comfort. However, the building energy management system (BEMS) is now facing more challenges and uncertainties with the increasing penetration of renewables and complicated interactions between humans and buildings. Classical model predictive control (MPC) has shown its capacity to reduce building energy consumption, but it suffers from labor-intensive modelling and complex on-line control optimization. Recently, with the growing accessibility to the building cont…
We study a smart grid with wind power and battery storage. Traditionally, day-ahead planning aims to balance demand and wind power, yet actual wind conditions often deviate from forecasts. Short-term flexibility in storage and generation fills potential gaps, planned on a minutes time scale for 30-60 minute horizons. Finding the optimal flexibility deployment requires solving a semi-infinite non-convex stochastic program, which is generally intractable to do exactly. Previous approaches rely on sampling, yet such critical problems call for rigorous approaches with stronger guarantees. Our meth…
A novel centralized model predictive control (MPC) is proposed for comfort and energy management in a residential building. The residential setup used here is equipped with a photovoltaic (PV) solar system and a stationary home battery unit. An air-to-air multi-split heat pump (HP) is used as the primary heating system. The electric baseboard (BB) unit in each zone is used as a secondary system. The MPC is simultaneously responsible for controlling the heating inputs of the HP and BB units for comfort management, as well as for the control of energy flow between the PV, the home battery and th…
An optimization model of a stormwater pond is developed to improve the performance of the system in terms of water quantity and quality. Nowadays, stormwater management systems play an important role in mitigating the impacts of urbanization on the natural hydrological cycle. These systems can be managed in such a way that they meet smart city needs. An automated dynamically managed system that can adapt itself to ever-changing environmental conditions can be modeled using a mathematical optimization approach. Hence, a Predictive Real-Time Control (PRTC) approach is proposed in this paper to o…
Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院）；elena international GmbH（elena国际有限公司）
Model predictive control (MPC) is a method to formulate the optimal scheduling problem for grid flexibilities in a mathematical manner. The resulting time-constrained optimization problem can be re-solved in each optimization time step using classical optimization methods such as Second Order Cone Programming (SOCP) or Interior Point Methods (IPOPT). When applying MPC in a rolling horizon scheme, the impact of uncertainty in forecasts on the optimal schedule is reduced. While MPC methods promise accurate results for time-constrained grid optimization they are inherently limited by the calculat…
The Digital Twins offer promising solutions for smart grid challenges related to the optimal operation, management, and control of energy assets, for safe and reliable distribution of energy. These challenges are more pressing nowadays than ever due to the large-scale adoption of distributed renewable resources at the edge of the grid. The digital twins are leveraging technologies such as the Internet of Things, big data analytics, machine learning, and cloud computing, to analyze data from different energy sensors, view and verify the status of physical energy assets and extract useful inform…
