While non-parametric models, such as neural networks, are sufficient in the load forecasting, separate estimates of fixed and shiftable loads are beneficial to a wide range of applications such as distribution system operational planning, load scheduling, energy trading, and utility demand response programs. A semi-parametric estimation model is usually required, where cost sensitivities of demands must be known. Existing research work consistently uses somewhat arbitrary parameters that seem to work best. In this paper, we propose a generic class of data-driven semiparametric models derived from consumption data of residential consumers. A two-stage machine learning approach is developed. In the first stage, disaggregation of the load into fixed and shiftable components is accomplished by means of a hybrid algorithm consisting of non-negative matrix factorization (NMF) and Gaussian mixture models (GMM), with the latter trained by an expectation-maximization (EM) algorithm. The fixed and shiftable loads are subject to analytic treatment with economic considerations. In the second stage, the model parameters are estimated using an L2-norm, epsilon-insensitive regression approach. Actual energy usage data of two residential customers show the validity of the proposed method.
University of Electronic Science and Technology of China（电子科技大学）；Shandong Normal University（山东师范大学）
Energy disaggregation, also known as non-intrusive load monitoring (NILM), challenges the problem of separating the whole-home electricity usage into appliance-specific individual consumptions, which is a typical application of data analysis. {NILM aims to help households understand how the energy is used and consequently tell them how to effectively manage the energy, thus allowing energy efficiency which is considered as one of the twin pillars of sustainable energy policy (i.e., energy efficiency and renewable energy).} Although NILM is unidentifiable, it is widely believed that the NILM pr…
In this paper, we address the challenge of recovering an accurate breakdown of aggregated tensor data using disaggregation examples. This problem is motivated by several applications. For example, given the breakdown of energy consumption at some homes, how can we disaggregate the total energy consumed during the same period at other homes? In order to address this challenge, we propose GRATE, a principled method that turns the ill-posed task at hand into a constrained tensor factorization problem. Then, this optimization problem is tackled using an alternating least-squares algorithm. GRATE h…
Residential smart meters have been widely installed in urban houses nationwide to provide efficient and responsive monitoring and billing for consumers. Studies have shown that providing customers with device-level usage information can lead consumers to economize significant amounts of energy, while modern smart meters can only provide informative whole-home data with low resolution. Thus, energy disaggregation research which aims to decompose the aggregated energy consumption data into its component appliances has attracted broad attention. In this paper, a discriminative disaggregation mode…
Lahore University of Management Sciences（拉合尔管理科学大学）；Georgia State University（佐治亚州立大学）；Hazara University（哈扎拉大学）；Islamic University（伊斯兰大学）
Accurate short-term load forecasting is essential for the efficient operation of the power sector. Forecasting load at a fine granularity such as hourly loads of individual households is challenging due to higher volatility and inherent stochasticity. At the aggregate levels, such as monthly load at a grid, the uncertainties and fluctuations are averaged out; hence predicting load is more straightforward. This paper proposes a method called Forecasting using Matrix Factorization (\textsc{fmf}) for short-term load forecasting (\textsc{stlf}). \textsc{fmf} only utilizes historical data from cons…
In the residential sector, electric water heaters are appliances with a relatively high power consumption and a significant thermal inertia, which is particularly suitable for Demand Response schemes. The success of efficient DR schemes via the control of water heaters presupposes an accurate estimate of their power demand at each instant. Although the load of water heaters is rarely directly measured, a large penetration of Smart Meters (SMs) in distribution grids enables to indirectly infer this information on a large scale via load disaggregation. For that purpose, a considerable number of …
Energy disaggregation is the task of segregating the aggregate energy of the entire building (as logged by the smartmeter) into the energy consumed by individual appliances. This is a single channel (the only channel being the smart-meter) blind source (different electrical appliances) separation problem. The traditional way to address this is via stochastic finite state machines (e.g. Factorial Hidden Markov Model). In recent times dictionary learning based approaches have shown promise in addressing the disaggregation problem. The usual technique is to learn a dictionary for every device and…
Energy disaggregation, known in the literature as Non-Intrusive Load Monitoring (NILM), is the task of inferring the power demand of the individual appliances given the aggregate power demand recorded by a single smart meter which monitors multiple appliances. In this paper, we propose a deep neural network that combines a regression subnetwork with a classification subnetwork for solving the NILM problem. Specifically, we improve the generalization capability of the overall architecture by including an encoder-decoder with a tailored attention mechanism in the regression subnetwork. The atten…
Southeast University（东南大学）；Jiangsu Intever Energy Technology Co. Ltd.（江苏英泰维能源科技有限公司）
With the increased demand on economy and efficiency of measurement technology, Non-Intrusive Load Monitoring (NILM) has received more and more attention as a cost-effective way to monitor electricity and provide feedback to users. Deep neural networks has been shown a great potential in the field of load disaggregation. In this paper, firstly, a new convolutional model based on residual blocks is proposed to avoid the degradation problem which traditional networks more or less suffer from when network layers are increased in order to learn more complex features. Secondly, we propose dilated co…
Season-Independent PV Disaggregation Using Multi-Scale Net Load Temporal Feature Extraction and Weather Factor Fusion
School of Computer Science and Technology University of Electronic Science and Technology of China（电子科学与技术大学计算机科学与技术学院）；Department of Data Science and AI Faculty of Information Technology Monash University（信息科技学院数据科学与人工智能系）；Monash Energy Institute Monash University（莫纳什大学能源研究所）；Shenzhen Institute for Advanced Study Shenzhen, China（深圳先进研究 institute）
Non-intrusive load monitoring (NILM) is the task of disaggregating the total power consumption into its individual sub-components. Over the years, signal processing and machine learning algorithms have been combined to achieve this. A lot of publications and extensive research works are performed on energy disaggregation or NILM for the state-of-the-art methods to reach on the desirable performance. The initial interest of the scientific community to formulate and describe mathematically the NILM problem using machine learning tools has now shifted into a more practical NILM. Nowadays, we are …
The increased awareness regarding the impact of energy consumption on the environment has led to an increased focus on reducing energy consumption. Feedback on the appliance level energy consumption can help in reducing the energy demands of the consumers. Energy disaggregation techniques are used to obtain the appliance level energy consumption from the aggregated energy consumption of a house. These techniques extract the energy consumption of an individual appliance as features and hence face the challenge of distinguishing two similar energy consuming devices. To address this challenge we …
In this work, a non intrusive load disaggregation scheme is proposed. By using a kernel based nonlinear regression strategy, the switching dynamic of an electric network, simulated as a set of RLC circuits with chaotic switching, is approximated using a time series of the total power consumption. The results suggest that the employed methodology can be useful in the design of efficient load disaggregation schemes.
The housing structures have changed with urbanization and the growth due to the construction of high-rise buildings all around the world requires end-use appliance energy conservation and management in real-time. This shift also came along with smart-meters which enabled the estimation of appliance-specific power consumption from the buildings aggregate power consumption reading. Non-intrusive load monitoring (NILM) or energy disaggregation is aimed at separating the household energy measured at the aggregate level into constituent appliances. Over the years, signal processing and machine lear…
École de Technologie Supérieure（高等技术学院）；Université du Québec（魁北克大学）；La Forge Research Laboratory - Ubisoft（育碧La Forge研究实验室）
Non-intrusive load monitoring (NILM) is a technique that uses a single sensor to measure the total power consumption of a building. Using an energy disaggregation method, the consumption of individual appliances can be estimated from the aggregate measurement. Recent disaggregation algorithms have significantly improved the performance of NILM systems. However, the generalization capability of these methods to different houses as well as the disaggregation of multi-state appliances are still major challenges. In this paper we address these issues and propose an energy disaggregation approach b…
University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Modern smart sensor-based energy management systems leverage non-intrusive load monitoring (NILM) to predict and optimize appliance load distribution in real-time. NILM, or energy disaggregation, refers to the decomposition of electricity usage conditioned on the aggregated power signals (i.e., smart sensor on the main channel). Based on real-time appliance power prediction using sensory technology, energy disaggregation has great potential to increase electricity efficiency and reduce energy expenditure. With the introduction of transformer models, NILM has achieved significant improvements i…
University of Hertfordshire（赫特福德大学）；Leeds Beckett University（利兹贝克特大学）
Smart meters are used to measure the energy consumption of households. Specifically, within the energy consumption task smart meter have been used for load forecasting, reduction of consumer bills as well as reduction of grid distortions. Except energy consumption smart meters can be used to disaggregate energy consumption on device level. In this paper we investigate the potential of identifying the multimedia content played by a TV or monitor device using the central house's smart meter measuring the aggregated energy consumption from all working appliances of the household. The proposed arc…
National Renewable Energy Laboratory（国家可再生能源实验室）；University of Virginia（弗吉尼亚大学）；University of Minnesota（明尼苏达大学）
Energy disaggregation is the task of discerning the energy consumption of individual appliances from aggregated measurements, which holds promise for understanding and reducing energy usage. In this paper, we propose PHASED, an optimization approach for energy disaggregation that has two key features: PHASED (i) exploits the structure of power distribution systems to make use of readily available measurements that are neglected by existing methods, and (ii) poses the problem as a minimization of a difference of submodular functions. We leverage this form by applying a discrete optimization var…
Existing methods of non-intrusive load monitoring (NILM) in literatures generally suffer from high computational complexity and/or low accuracy in identifying working household appliances. This paper proposes an event-driven Factorial Hidden Markov model (eFHMM) for multiple appliances with multiple states in a household, aiming for low computational complexity and high load disaggregation accuracy. The proposed eFHMM decreases the computational complexity to be linear to the event number, which ensures online load disaggregation. Furthermore, the eFHMM is solved in two stages, where the first…
University of Klagenfurt（克拉根福大学）；Simon Fraser University（西蒙弗雷泽大学）
Non-Intrusive Load Monitoring (NILM) comprises of a set of techniques that provide insights into the energy consumption of households and industrial facilities. Latest contributions show significant improvements in terms of accuracy and generalisation abilities. Despite all progress made concerning disaggregation techniques, performance evaluation and comparability remains an open research question. The lack of standardisation and consensus on evaluation procedures makes reproducibility and comparability extremely difficult. In this paper, we draw attention to comparability in NILM with a focu…
International Institute of Information Technology, Hyderabad（海得拉巴国际信息技术学院）
Individual device loads and energy consumption feedback is one of the important approaches for pursuing users to save energy in residences. This can help in identifying faulty devices and wasted energy by devices when left On unused. The main challenge is to identity and estimate the energy consumption of individual devices without intrusive sensors on each device. Non-intrusive load monitoring (NILM) or energy disaggregation, is a blind source separation problem which requires a system to estimate the electricity usage of individual appliances from the aggregated household energy consumption.…
Rooftop solar photovoltaic (PV) power generator is a widely used distributed energy resource (DER) in distribution systems. Currently, the majority of PVs are installed behind-the-meter (BTM), where only customers' net demand is recorded by smart meters. Disaggregating BTM PV generation from net demand is critical to utilities for enhancing grid-edge observability. In this paper, a data-driven approach is proposed for BTM PV generation disaggregation using solar and demand exemplars. First, a data clustering procedure is developed to construct a library of candidate load/solar exemplars. To ha…
This paper presents a new algorithm to extract device profiles fully unsupervised from three phases reactive and active aggregate power measurements. The extracted device profiles are applied for the disaggregation of the aggregate power measurements using particle swarm optimization. Finally, this paper provides a new approach for short term power predictions using the disaggregation data. For this purpose, a state changes forecast for every device is carried out by an artificial neural network and converted into a power prediction afterwards by reconstructing the power regarding the state ch…
Energy Disaggregation & Appliance Identification in a Smart Home: Transfer Learning enables Edge Computing
Information Technology University（信息技术大学）；Hamad Bin Khalifa University (HBKU)（哈马德·本·哈利法大学）；The University of Lahore（拉合尔大学）；University of Essex（埃塞克斯大学）；University of Glasgow（格拉斯哥大学）；Ajman University（阿治曼大学）
University of Surrey（萨里大学）；VU University Amsterdam（阿姆斯特丹自由大学）
Energy disaggregation, a.k.a. Non-Intrusive Load Monitoring, aims to separate the energy consumption of individual appliances from the readings of a mains power meter measuring the total energy consumption of, e.g. a whole house. Energy consumption of individual appliances can be useful in many applications, e.g., providing appliance-level feedback to the end users to help them understand their energy consumption and ultimately save energy. Recently, with the availability of large-scale energy consumption datasets, various neural network models such as convolutional neural networks and recurre…
Advanced metering infrastructure systems record a high volume of residential load data, opening up an opportunity for utilities to understand consumer energy consumption behaviors. Existing studies have focused on load profiling and prediction, but neglected the role of socioeconomic characteristics of consumers in their energy consumption behaviors. In this paper, we develop a prediction model using deep neural networks to predict load patterns of consumers based on their socioeconomic information. We analyze load patterns using the K-means clustering method and use an entropy-based feature s…
In order to increase the electric energy efficiency of production machines, it is necessary to determine the energy demand of the constituent electric loads. Therefore, a new measurement system based on nonintrusive load monitoring is proposed in this paper. It only measures the voltage and current of the aggregate load and then uses automatic disaggregation methods to estimate the energy demand of the constituent loads. In two case studies, the energy demand of most loads could be determined with an accuracy of 85~\% or more in this way.
Deep learning models for non-intrusive load monitoring (NILM) tend to require a large amount of labeled data for training. However, it is difficult to generalize the trained models to unseen sites due to different load characteristics and operating patterns of appliances between data sets. For addressing such problems, self-supervised learning (SSL) is proposed in this paper, where labeled appliance-level data from the target data set or house is not required. Initially, only the aggregate power readings from target data set are required to pre-train a general network via a self-supervised pre…
Non-intrusive load monitoring (NILM) or energy disaggregation aims to break down total household energy consumption into constituent appliances. Prior work has shown that providing an energy breakdown can help people save up to 15\% of energy. In recent years, deep neural networks (deep NNs) have made remarkable progress in the domain of NILM. In this paper, we demonstrate the performance of Gaussian Processes (GPs) for NILM. We choose GPs due to three main reasons: i) GPs inherently model uncertainty; ii) equivalence between infinite NNs and GPs; iii) by appropriately designing the kernel we …
Energy Injection Identification enabled Disaggregation with Deep Multi-Task Learning
The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；The Hong Kong University of Science（香港科学大学）；Southern University of Science（南方科技大学）；University of Cambridge（剑桥大学）
The issue of estimating the detailed appliance level load consumption has received considerable attention. This paper first presents a Labelled hIgh-Frequency daTaset for Electricity Disaggregation (LIFTED), which can be used for research on nonintrusive load monitoring (NILM). This dataset consists of one-week detailed appliance-level electricity usage information including voltage, current, active power, and reactive power for a single apartment in the United States, down-sampled at 50Hz. This paper also proposes an efficient Lossless Coding considering Precision (LCP) algorithm on data comp…
The real-time statistics on key consumer parameters and key utility parameters earmark the implementation of demand response (DR) under the smart grid (SG) paradigm. Advanced metering infrastructure (AMI) enables monitoring and control over both key parameters to reflect reliable information on SG. Firstly, this paper aims at a physical realization of an AMI, which comprises a meter data management system (MDMS) supported by smart meters. Secondly, a sliding window based non-intrusive load monitoring algorithm is proposed to illustrate the power consumption pattern. The MDMS features an increm…
Electrical load profiling supports retailers and distribution network operators in having a better understanding of the consumption behavior of consumers. However, traditional clustering methods for load profiling are centralized and require access to all the smart meter data, thus causing privacy issues for consumers and retailers. To tackle this issue, we propose a privacy-preserving distributed clustering framework for load profiling by developing a privacy-preserving accelerated average consensus (PP-AAC) algorithm with proven convergence. Using the proposed framework, we modify several co…
The rising demand for electricity and its essential nature in today's world calls for intelligent home energy management (HEM) systems that can reduce energy usage. This involves scheduling of loads from peak hours of the day when energy consumption is at its highest to leaner off-peak periods of the day when energy consumption is relatively lower thereby reducing the system's peak load demand, which would consequently result in lesser energy bills, and improved load demand profile. This work introduces a novel way to develop a learning system that can learn from experience to shift loads from…
Tsinghua University（清华大学）；University of California, Santa Cruz（加州大学圣克鲁兹分校）；ETH Zürich（苏黎世联邦理工学院）
Non-intrusive load monitoring addresses the challenging task of decomposing the aggregate signal of a household's electricity consumption into appliance-level data without installing dedicated meters. By detecting load malfunction and recommending energy reduction programs, cost-effective non-intrusive load monitoring provides intelligent demand-side management for utilities and end users. In this paper, we boost the accuracy of energy disaggregation with a novel neural network structure named scale- and context-aware network, which exploits multi-scale features and contextual information. Spe…
Universidad Carlos III de Madrid（马德里卡洛斯三世大学）；UC3M-Santander Big Data Institute (IBiDat)（马德里卡洛斯三世大学-桑坦德大数据研究所（IBiDat））
Most electricity systems worldwide are deploying advanced metering infrastructures to collect relevant operational data. In particular, smart meters allow tracking electricity load consumption at a very disaggregated level and at high frequency rates. This data opens the possibility of developing new forecasting models with a potential positive impact in electricity systems. We present a general methodology that is able to process and forecast a large number of smart meter time series. Instead of using traditional and univariate approaches, we develop a single but complex recurrent neural-netw…
The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））
Non-intrusive load monitoring (NILM) aims at decomposing the total reading of the household power consumption into appliance-wise ones, which is beneficial for consumer behavior analysis as well as energy conservation. NILM based on deep learning has been a focus of research. To train a better neural network, it is necessary for the network to be fed with massive data containing various appliances and reflecting consumer behavior habits. Therefore, data cooperation among utilities and DNOs (distributed network operators) who own the NILM data has been increasingly significant. During the coope…
Under Smart Grid environment, the consumers may respond to incentive--based smart energy tariffs for a particular consumption pattern. Demand Response (DR) is a portfolio of signaling schemes from the utility to the consumers for load shifting/shedding with a given deadline. The signaling schemes include Time--of--Use (ToU) pricing, Maximum Demand Limit (MDL) signals etc. This paper proposes a DR algorithm which schedules the operation of home appliances/loads through a minimization problem. The category of loads and their operational timings in a day have been considered as the operational pa…
Non-Intrusive Load Monitoring (NILM) is a practical method to provide appliance-level electricity consumption information. Event detection, as an important part of event-based NILM methods, has a direct impact on the accuracy of the ultimate load disaggregation results in the entire NILM framework. This paper presents a hybrid event detection approach for relatively complex household load datasets that include appliances with long transients, high fluctuations, and/or near-simultaneous actions. The proposed approach includes a base algorithm based on moving average change with time limit, and …
School of Computer Electronics and Information, Guangxi University（广西大学计算机与电子信息学院）；Guangxi Key Laboratory of Multimedia Communication and Network Technology, Guangxi University（广西大学广西多媒体通信与网络技术重点实验室）；School of Electrical Engineering, Guangxi University（广西大学电气工程学院）；Guangxi Key Laboratory of Power System Optimization and Energy Technology, Guangxi University（广西大学广西电力系统优化与能源技术重点实验室）
Non Intrusive Load Monitoring (NILM) or Energy Disaggregation (ED), seeks to save energy by decomposing corresponding appliances power reading from an aggregate power reading of the whole house. It is a single channel blind source separation problem (SCBSS) and difficult prediction problem because it is unidentifiable. Recent research shows that deep learning has become a growing popularity for NILM problem. The ability of neural networks to extract load features is closely related to its depth. However, deep neural network is difficult to train because of exploding gradient, vanishing gradien…
