Regarding the variability of renewable energy sources (RESs), especially in the operation time periods, their high penetration faces the net load pattern of the power system with a major ramp rate challenge. Although employing a market-based mechanism by the independent system operator (ISO) can address this challenge, it may not be possible to handle this challenge in all networks. In such networks, the required flexibility can be supplied by decreasing the ramp rate of the purchased power of distribution companies (Discos) from the market since their net load has an important impact on the system's netload. Therefore, a flexibility-constrained operation problem for the distribution networks with distributed energy resources (DERs) and microgrids (MGs) is proposed in this paper to decrease the ramp-rate of the Disco's purchased power from the market. This problem is formulated using a bi-level two-stage stochastic model where the problem of the Disco and the MGs are modeled as the upper-level and lower-level problems, respectively. The proposed model is applied to the IEEE 33-bus standard test network with three MGs. The results show the effectiveness of the proposed model to decrease the ramp-rate of the Disco's purchased power from the market.
Microgrids with AC/DC architecture benefit from advantages of both AC and DC power. In this paper, daily operation problem for a zero-carbon AC/DC microgrid in presence of electric vehicles (EVs) is considered. In this framework, EVs' batteries are mobile energy storage systems, which allow desirable operation of the microgrid during peak demand hours. This study shows in absence of storage system, EVs' batteries can be properly managed to satisfy the system requirements. In the case studies, several sensitivity analyses based on variations in battery degradation costs, solar irradiance, and i…
A cooperative energy scheduling method is proposed that allows joint energy optimization for a group of microgrids to achieve cost savings that the microgrids could not achieve individually. The discussed microgrids may be commercial entities in a distribution network under utility electricity rate plans comprising both Time of Use (ToU) and peak demand charge. Defining a stable operation as a situation where all microgrids would be willing to participate, it is shown that under such rate plans and in particular due to the peak demand charge, a cost distribution that is seemingly fair does not…
This letter investigates a Branching Dueling Q-Network (BDQ) based online operation strategy for a microgrid with distributed battery energy storage systems (BESSs) operating under uncertainties. The developed deep reinforcement learning (DRL) based microgrid online optimization strategy can achieve a linear increase in the number of neural network outputs with the number of distributed BESSs, which overcomes the curse of dimensionality caused by the charge and discharge decisions of multiple BESSs. Numerical simulations validate the effectiveness of the proposed method.
Risk analysis is currently not quantified in microgrid resource scheduling optimization. This paper conducts a conditional value at risk (cVaR) analysis on a grid-disconnected residential microgrid with distributed energy resources (DER). We assume the infrastructure to set up an ad-hoc microgrid is already in place for a residential neighborhood with power sources such as photovoltaic (PV), diesel, and battery energy storage system (BESS). With this scenario in mind, we solve day-ahead scheduling to optimally allocate various resources to match demand in scenarios where neighborhoods, especia…
In order to prevent the potential frequency instability due to the high Power Electronics (PE) penetration under an unintentional islanding event, this paper presents a novel microgrid scheduling model which explicitly models the system frequency dynamics as well as the long/short term uncertainty associated with renewable energy resources and load. Synthetic Inertia (SI) control is applied to regulating the active power output of the Inverter-Based Generators (IBGs) to support the post-islanding frequency evaluation. The uncertainty associated with the noncritical load shedding is explicitly …
The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power generations is still a tough task. To achieve online scheduling of a residential microgrid (RM) that does not need a forecast model to predict the future PV/wind and load power sequences, this paper investigates the usage of reinforcement learning (RL) approach to tackle this challenge. Specifically, based on the recent development of Model-Based Reinforcement …
The development of renewable energy generation empowers microgrids to generate electricity to supply itself and to trade the surplus on energy markets. To minimize the overall cost, a microgrid must determine how to schedule its energy resources and electrical loads and how to trade with others. The control decisions are influenced by various factors, such as energy storage, renewable energy yield, electrical load, and competition from other microgrids. Making the optimal control decision is challenging, due to the complexity of the interconnected microgrids, the uncertainty of renewable energ…
With the popularization of the electric vehicles (EVs), EV charging demand is becoming an important load in the building. Considering the mobility of EVs from building to building and their uncertain charging demand, it is of great practical interest to control the EV charging process in a microgrid of buildings to optimize the total operation cost while ensuring the transmission safety between the microgrid and the main grid. We consider this important problem in this paper and make the following contributions. First, we formulate this problem as a Markov decision process to capture the uncer…
This paper presents an optimization approach based on the mixed-integer programming (MIP) to maximize the profit of the Microgrid (MG) while minimizing the risk in profit (RIP) in the presence of demand response program (DRP). RIP is defined as the risk of gaining less profit from the desired profit values. The uncertainties associated with the RESs and loads are modeled using normal, Beta, and Weibull distribution functions. The simulation studies are performed in GAMS and MATLAB for 5 random days in a year. The simulation results show that RIP is reduced when downside risk constraint (DRC) i…
Islamic Azad University（伊斯兰阿扎德大学）；Iranian University of Science and Technology（伊朗科技大学）；Shiraz University of Technology（设拉子理工大学）；Electric reliability council of Texas（得克萨斯州电力可靠性委员会）
In terms of the operation of microgrids, optimal scheduling is a vital issue that must be taken into account. In this regard, this paper proposes an effective framework for optimal scheduling of renewable microgrids considering energy storage devices, wind turbines, micro turbines. Due to the nonlinearity and complexity of operation problems in microgrids, it is vital to use an accurate and robust optimization technique to efficiently solve this problem. To this end, in the proposed framework, the teacher learning-based optimization is utilized to efficiently solve the scheduling problem in th…
Online decision-making in the presence of uncertain future information is abundant in many problem domains. In the critical problem of energy generation scheduling for microgrids, one needs to decide when to switch energy supply between a cheaper local generator with startup cost and the costlier on-demand external grid, considering intermittent renewable generation and fluctuating demands. Without knowledge of future input, competitive online algorithms are appealing as they provide optimality guarantees against the optimal offline solution. In practice, however, future input, e.g., wind gene…
The emerging paradigm of interconnected microgrids advocates energy trading or sharing among multiple microgrids. It helps make full use of the temporal availability of energy and diversity in operational costs when meeting various energy loads. However, energy trading might not completely absorb excess renewable energy. A multi-energy management framework including fuel cell vehicles, energy storage, combined heat and power system, and renewable energy is proposed, and the characteristics and scheduling arrangements of fuel cell vehicles are considered to further improve the local absorption …
In the context of transition towards cleaner and sustainable energy production, microgrids have become an effective way for tackling environmental pollution and energy crisis issues. With the increasing penetration of renewables, how to coordinate demand response and renewable generations is a critical and challenging issue in the field of microgrid scheduling. To this end, a bi-level scheduling model is put forward for isolated microgrids with consideration of multi-stakeholders in this paper, where the lower- and upper-level models respectively aim to the minimization of user cost and microg…
In this work, a novel optimal scheduling approach is proposed for isolated microgrids (MGs) with renewable generations by incorporating demand response of electric vehicles (EVs). First, a bi-level programming-based MG scheduling model is proposed under real-time pricing environments, where the upper- and lower- levels seek to minimize the MG net operating cost and the EV charging cost. Second, a hybrid solution algorithm called JAYA-interior point method is put forward to solve the model. And finally, the simulation results demonstrate that incorporating demand response of electric vehicles i…
Distribution system integrated community microgrids (CMGs) can restore loads during extended outages. The CMG is challenged with limited resource availability, absence of a robust grid-support, and demand-supply uncertainty. To address these challenges, this paper proposes a three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) dispatch of CMGs. The CMG's ability to dynamically expand its boundary to support the neighboring grid sections is also considered. The first stage solves a stochastic day-ahead (DA) scheduling problem to obtain referral plans for optimal …
Northeast Electric Power University（东北电力大学）；State Grid Beijing Electric Power Company（国网北京市电力公司）
In order to reduce the negative impact of the uncertainty of load and renewable energies outputs on microgrid operation, an optimal scheduling model is proposed for isolated microgrids by using automated reinforcement learning-based multi-period forecasting of renewable power generations and loads. Firstly, a prioritized experience replay automated reinforcement learning (PER-AutoRL) is designed to simplify the deployment of deep reinforcement learning (DRL)-based forecasting model in a customized manner, the single-step multi-period forecasting method based on PER-AutoRL is proposed for the f…
A bargaining game is investigated for cooperative energy management in microgrids. This game incorporates a fully distributed and realistic cooperative power scheduling algorithm (CoDES) as well as a distributed Nash Bargaining Solution (NBS)-based method of allocating the overall power bill resulting from CoDES. A novel weather-based stochastic renewable generation (RG) prediction method is incorporated in the power scheduling. We demonstrate the proposed game using a 4-user grid-connected microgrid model with diverse user demands, storage, and RG profiles and examine the effect of weather pr…
We consider the problem of energy management in microgrid networks. A microgrid is capable of generating a limited amount of energy from a renewable resource and is responsible for handling the demands of its dedicated customers. Owing to the variable nature of renewable generation and the demands of the customers, it becomes imperative that each microgrid optimally manages its energy. This involves intelligently scheduling the demands at the customer side, selling (when there is a surplus) and buying (when there is a deficit) the power from its neighboring microgrids depending on its current …
Microgrids offer flexibility in power generation in a way of using multiple renewable energy sources. In the past few years, microgrids become a very active research area in terms of design and control strategies. Most of the microgrids use DC/DC converters to connect renewable energy sources to the load. In this paper, the simulation model of a DC microgrid with three different energy sources (Lithium-ion battery (LIB), photovoltaic (PV) array, and fuel cell) and external variant power load is built with MATLAB/Simulink and the simulative results show that the stability of DC microgrid can be…
Argonne National Laboratory（阿贡国家实验室）；Oak Ridge National Laboratory（橡树岭国家实验室）
In this paper, we introduce a deep learning aided constraint encoding method to tackle the frequency-constraint microgrid scheduling problem. The nonlinear function between system operating condition and frequency nadir is approximated by using a neural network, which admits an exact mixed-integer formulation (MIP). This formulation is then integrated with the scheduling problem to encode the frequency constraint. With the stronger representation power of the neural network, the resulting commands can ensure adequate frequency response in a realistic setting in addition to islanding success. T…
Networking of microgrids can provide the operational flexibility needed for the increasing number of DERs deployed at the distribution level and supporting end-use demand when there is loss of the bulk power system. But, networked microgrids are vulnerable to cyber-physical attacks and faults due to the complex interconnections. As such, it is necessary to design resilient control systems to support the operations of networked microgrids in responses to cyber-physical attacks and faults. This paper introduces a resilient communication scheme for interconnecting multiple microgrids to support c…
High penetration of renewable generation poses great challenge to power system operation due to its uncertain nature. In droop-controlled microgrids, the voltage volatility induced by renewable uncertainties is aggravated by the high droop gains. This paper proposes a chance-constrained optimal power flow (CC-OPF) problem with power flow routers (PFRs) to better regulate the voltage profile in microgrids. PFR refer to a general type of network-side controller that brings more flexibility to the power network. Comparing with the normal CC-OPF that relies on power injection flexibility only, the…
Distribution system integrated community microgrids (CMGs) can partake in restoring loads during extended duration outages. At such times, the CMG is challenged with limited resource availability, absence of robust grid support, and heightened demand-supply uncertainty. This paper proposes a secure and adaptive three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) dispatch of CMGs with hybrid PV systems to address these challenges. The framework enables the CMG to dynamically expand its boundary to support the neighboring grid sections and is adaptive to the chan…
In this report, several control strategies for microgrids with renewable energy resources and battery energy storage systems are proposed. Renewable energy has the potential to reduce global carbon emissions, while higher penetration of renewable energy is hindered by the inherent variability and intermittency of renewable resources. This motivates the development of microgrids supplied by renewable energy resources. With proper control of storage units and communications with the energy market, the non-dispatchable energy can be regulated to reduce the difficulty of power scheduling in the gr…
The capability to switch between grid-connected and islanded modes has promoted adoption of microgrid technology for powering remote locations. Stabilizing frequency during the islanding event, however, is a challenging control task, particularly under high penetration of converter-interfaced sources. In this paper, a numerical optimal control (NOC)-based control synthesis methodology is proposed for preparedness of microgrid islanding that ensure guaranteed performance. The key feature of the proposed paradigm is near real-time centralized scheduling for real-time decentralized executing. For…
To accommodate the advent of microgrids (MG) managing distributed energy resources (DER) in distribution systems, an interactive two-stage joint retail electricity market mechanism is proposed to provide an effective platform for these prosumers to proactively join in retail transactions. Day-ahead stochastic energy trading between the distribution system operator (DSO) and MGs is conducted in the first stage of a centralized retail market, where a chance-constrained uncertainty distribution locational marginal price (CC-UDLMP) containing the cost of uncertainty precautions is used to settle t…
Interdisciplinary Graduate School, Nanyang Technological University Singapore（南洋理工大学跨学科研究生院（新加坡））；School of Electrical and Electronic Engineering, Nanyang Technological University Singapore（南洋理工大学电气与电子工程学院（新加坡））
Mobile energy storage systems (MESSs) provide mobility and flexibility to enhance distribution system resilience. The paper proposes a Markov decision process (MDP) formulation for an integrated service restoration strategy that coordinates the scheduling of MESSs and resource dispatching of microgrids. The uncertainties in load consumption are taken into account. The deep reinforcement learning (DRL) algorithm is utilized to solve the MDP for optimal scheduling. Specifically, the twin delayed deep deterministic policy gradient (TD3) is applied to train the deep Q-network and policy network, t…
This paper presents a novel grid-forming voltage control strategy for a battery energy storage system to maintain balanced three-phase output voltages when serving unbalanced loads. A stationary reference frame ($αβ$) based control scheme is proposed to regulate positive-sequence and negative-sequence voltages. Compared with the conventional rotating reference frame ($dq$) based control scheme, the proposed scheme shows better dynamic performance. Then, we analyze the system zero-sequence network and propose adding a grounding transformer to the Y/Yg connected output transformer to further red…
Large-scale successful integration of microgeneration, together with active loads, energy storage devices, and energy scheduling strategies, requires the extensive adoption of advanced information and communication technologies (ICTs) at the distribution network level; this brings so-called Cyber-Physical Multi-MicroGrid (CPMMG) systems into the picture. However, as such ICTs are not failure-free, their integration affects the system's operation and adequacy. To quantify how cyber failures influence a CPMMG system, this study proposes an adequacy framework based on sequential Monte Carlo Simul…
Microgrids are being increasing deployed to improve the operational flexibility, resilience, coordinated-energy management capabilities, self-adequacy, and increased reliability of power systems. This strong market growth is also driven by advances in power electronics, improved control systems, and the rapidly falling price and increased adoption of distributed energy generation technologies, like solar photovoltaics and storage. In the event of grid outages, microgrids can provide a backup source of power; providing resilience to the critical loads; however, this requires that the microgrid …
