With the popularization of the electric vehicles (EVs), EV charging demand is becoming an important load in the building. Considering the mobility of EVs from building to building and their uncertain charging demand, it is of great practical interest to control the EV charging process in a microgrid of buildings to optimize the total operation cost while ensuring the transmission safety between the microgrid and the main grid. We consider this important problem in this paper and make the following contributions. First, we formulate this problem as a Markov decision process to capture the uncertain supply and EV charging demand in the microgrid of buildings. Besides reducing the total operation cost of buildings, the model also considers the power exchange limitation to ensure transmission safety. Second, this model is reformulated under event-based optimization framework to alleviate the impact of large state and action space. By appropriately defining the event and event-based action, the EV charging process can be optimized by searching a randomized parametric event-based control policy in the microgrid controller and implementing a selecting-to-charging rule in each building controller. Third, a constrained gradient-based policy optimzation method with adjusting mechanism is proposed to iteratively find the optimal event-based control policy for EV charging demand in each building. Numerical experiments considering a microgrid of three buildings are conducted to analyze the structure and the performance of the event-based control policy for EV charging.
Microgrids with AC/DC architecture benefit from advantages of both AC and DC power. In this paper, daily operation problem for a zero-carbon AC/DC microgrid in presence of electric vehicles (EVs) is considered. In this framework, EVs' batteries are mobile energy storage systems, which allow desirable operation of the microgrid during peak demand hours. This study shows in absence of storage system, EVs' batteries can be properly managed to satisfy the system requirements. In the case studies, several sensitivity analyses based on variations in battery degradation costs, solar irradiance, and i…
A cooperative energy scheduling method is proposed that allows joint energy optimization for a group of microgrids to achieve cost savings that the microgrids could not achieve individually. The discussed microgrids may be commercial entities in a distribution network under utility electricity rate plans comprising both Time of Use (ToU) and peak demand charge. Defining a stable operation as a situation where all microgrids would be willing to participate, it is shown that under such rate plans and in particular due to the peak demand charge, a cost distribution that is seemingly fair does not…
This letter investigates a Branching Dueling Q-Network (BDQ) based online operation strategy for a microgrid with distributed battery energy storage systems (BESSs) operating under uncertainties. The developed deep reinforcement learning (DRL) based microgrid online optimization strategy can achieve a linear increase in the number of neural network outputs with the number of distributed BESSs, which overcomes the curse of dimensionality caused by the charge and discharge decisions of multiple BESSs. Numerical simulations validate the effectiveness of the proposed method.
Risk analysis is currently not quantified in microgrid resource scheduling optimization. This paper conducts a conditional value at risk (cVaR) analysis on a grid-disconnected residential microgrid with distributed energy resources (DER). We assume the infrastructure to set up an ad-hoc microgrid is already in place for a residential neighborhood with power sources such as photovoltaic (PV), diesel, and battery energy storage system (BESS). With this scenario in mind, we solve day-ahead scheduling to optimally allocate various resources to match demand in scenarios where neighborhoods, especia…
In order to prevent the potential frequency instability due to the high Power Electronics (PE) penetration under an unintentional islanding event, this paper presents a novel microgrid scheduling model which explicitly models the system frequency dynamics as well as the long/short term uncertainty associated with renewable energy resources and load. Synthetic Inertia (SI) control is applied to regulating the active power output of the Inverter-Based Generators (IBGs) to support the post-islanding frequency evaluation. The uncertainty associated with the noncritical load shedding is explicitly …
The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power generations is still a tough task. To achieve online scheduling of a residential microgrid (RM) that does not need a forecast model to predict the future PV/wind and load power sequences, this paper investigates the usage of reinforcement learning (RL) approach to tackle this challenge. Specifically, based on the recent development of Model-Based Reinforcement …
The development of renewable energy generation empowers microgrids to generate electricity to supply itself and to trade the surplus on energy markets. To minimize the overall cost, a microgrid must determine how to schedule its energy resources and electrical loads and how to trade with others. The control decisions are influenced by various factors, such as energy storage, renewable energy yield, electrical load, and competition from other microgrids. Making the optimal control decision is challenging, due to the complexity of the interconnected microgrids, the uncertainty of renewable energ…
This paper presents an optimization approach based on the mixed-integer programming (MIP) to maximize the profit of the Microgrid (MG) while minimizing the risk in profit (RIP) in the presence of demand response program (DRP). RIP is defined as the risk of gaining less profit from the desired profit values. The uncertainties associated with the RESs and loads are modeled using normal, Beta, and Weibull distribution functions. The simulation studies are performed in GAMS and MATLAB for 5 random days in a year. The simulation results show that RIP is reduced when downside risk constraint (DRC) i…
Lately, increasing number of electric vehicles (EVs) in residential parking station has become an important issue, because excessive number of EVs can destabilize the power system during peak hours with high charging power requested. When the power system of the residential parking station takes the structure of microgrid (MG), power provision for the EVs requires efficient power management scheme. To minimize the maintenance cost of the MG and maintain the grid stability, the MG needs to balance the charging/discharging power of EVs in the parking station. To achieve these goals, this paper p…
Online decision-making in the presence of uncertain future information is abundant in many problem domains. In the critical problem of energy generation scheduling for microgrids, one needs to decide when to switch energy supply between a cheaper local generator with startup cost and the costlier on-demand external grid, considering intermittent renewable generation and fluctuating demands. Without knowledge of future input, competitive online algorithms are appealing as they provide optimality guarantees against the optimal offline solution. In practice, however, future input, e.g., wind gene…
Islamic Azad University（伊斯兰阿扎德大学）；Iranian University of Science and Technology（伊朗科技大学）；Shiraz University of Technology（设拉子理工大学）；Electric reliability council of Texas（得克萨斯州电力可靠性委员会）
In terms of the operation of microgrids, optimal scheduling is a vital issue that must be taken into account. In this regard, this paper proposes an effective framework for optimal scheduling of renewable microgrids considering energy storage devices, wind turbines, micro turbines. Due to the nonlinearity and complexity of operation problems in microgrids, it is vital to use an accurate and robust optimization technique to efficiently solve this problem. To this end, in the proposed framework, the teacher learning-based optimization is utilized to efficiently solve the scheduling problem in th…
The emerging paradigm of interconnected microgrids advocates energy trading or sharing among multiple microgrids. It helps make full use of the temporal availability of energy and diversity in operational costs when meeting various energy loads. However, energy trading might not completely absorb excess renewable energy. A multi-energy management framework including fuel cell vehicles, energy storage, combined heat and power system, and renewable energy is proposed, and the characteristics and scheduling arrangements of fuel cell vehicles are considered to further improve the local absorption …
As the number of electric vehicles (EVs) significantly increases, the excessive charging demand of parked EVs in the charging station may incur an instability problem to the electricity network during peak hours. For the charging station to take a microgrid (MG) structure, an economical and energy-efficient power management scheme is required for the power provision of EVs while considering the local load demand of the MG. For these purposes, this study presents the power management scheme of interdependent MG and EV fleets aided by a novel EV charg-ing/discharging scheduling algorithm. In thi…
In the context of transition towards cleaner and sustainable energy production, microgrids have become an effective way for tackling environmental pollution and energy crisis issues. With the increasing penetration of renewables, how to coordinate demand response and renewable generations is a critical and challenging issue in the field of microgrid scheduling. To this end, a bi-level scheduling model is put forward for isolated microgrids with consideration of multi-stakeholders in this paper, where the lower- and upper-level models respectively aim to the minimization of user cost and microg…
In this work, a novel optimal scheduling approach is proposed for isolated microgrids (MGs) with renewable generations by incorporating demand response of electric vehicles (EVs). First, a bi-level programming-based MG scheduling model is proposed under real-time pricing environments, where the upper- and lower- levels seek to minimize the MG net operating cost and the EV charging cost. Second, a hybrid solution algorithm called JAYA-interior point method is put forward to solve the model. And finally, the simulation results demonstrate that incorporating demand response of electric vehicles i…
Distribution system integrated community microgrids (CMGs) can restore loads during extended outages. The CMG is challenged with limited resource availability, absence of a robust grid-support, and demand-supply uncertainty. To address these challenges, this paper proposes a three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) dispatch of CMGs. The CMG's ability to dynamically expand its boundary to support the neighboring grid sections is also considered. The first stage solves a stochastic day-ahead (DA) scheduling problem to obtain referral plans for optimal …
Regarding the variability of renewable energy sources (RESs), especially in the operation time periods, their high penetration faces the net load pattern of the power system with a major ramp rate challenge. Although employing a market-based mechanism by the independent system operator (ISO) can address this challenge, it may not be possible to handle this challenge in all networks. In such networks, the required flexibility can be supplied by decreasing the ramp rate of the purchased power of distribution companies (Discos) from the market since their net load has an important impact on the s…
Pohang University of Science and Technology（浦项科技大学）；Ewha Womans University（梨花女子大学）；Hongik University（弘益大学）
A microgrid is an innovative system that integrates distributed energy resources to supply electricity demand within electrical boundaries. This study proposes an approach for deriving a desirable microgrid operation policy that enables sophisticated controls in the microgrid system using the proposed novel credit assignment technique, delayed-Q update. The technique employs novel features such as the ability to tackle and resolve the delayed effective property of the microgrid, which prevents learning agents from deriving a well-fitted policy under sophisticated controls. The proposed techniq…
The large adoption of EVs brings practical interest to the operation optimization of the charging station. The joint scheduling of pricing and charging control will achieve a win-win situation both for the charging station and EV drivers, thus enhancing the operational capability of the station. We consider this important problem in this paper and make the following contributions. First, a joint scheduling model of pricing and charging control is developed to maximize the expected social welfare of the charging station considering the Quality of Service and the price fluctuation sensitivity of…
We develop a new algorithm for scheduling the charging process of a large number of electric vehicles (EVs) over a finite horizon. We assume that EVs arrive at the charging stations with different charge levels and different flexibility windows. The arrival process is assumed to have a known distribution and that the charging process of EVs can be preemptive. We pose the scheduling problem as a dynamic program with constraints. We show that the resulting formulation leads to a monotone dynamic program with Lipschitz continuous value functions that are robust against perturbation of system para…
Northeast Electric Power University（东北电力大学）；State Grid Beijing Electric Power Company（国网北京市电力公司）
In order to reduce the negative impact of the uncertainty of load and renewable energies outputs on microgrid operation, an optimal scheduling model is proposed for isolated microgrids by using automated reinforcement learning-based multi-period forecasting of renewable power generations and loads. Firstly, a prioritized experience replay automated reinforcement learning (PER-AutoRL) is designed to simplify the deployment of deep reinforcement learning (DRL)-based forecasting model in a customized manner, the single-step multi-period forecasting method based on PER-AutoRL is proposed for the f…
Operators who deploy large fleets of electric vehicles often face a challenging charge scheduling problem. Specifically, time-ineffective recharging operations limit the profitability of charging during service operations such that operators recharge vehicles off-duty at a central depot. Here, high investment cost and grid capacity limit available charging infrastructure such that operators need to schedule charging operations to keep the fleet operational. In this context, flexible service operations, i.e. allowing to delay or expedite vehicle departures, can potentially increase charger util…
Electrical Vehicle Charging Station Profit Maximization: Admission, Pricing, and Online Scheduling
The Chinese University of Hong Kong（香港中文大学）；Shenzhen Research Institute, The Chinese University of Hong Kong（香港中文大学深圳研究院）；College of Information Engineering, Shenzhen University（深圳大学信息工程学院）
本文提出JoAP机制，通过联合优化电动汽车接入控制、定价和充电调度，提升充电站利润。通过 tandem 队列网络模型分析，设计最优算法并在模拟中验证其在不同等待时间惩罚率下利润提升达330%-531%。
The increased uptake of electric vehicles (EVs) leads to increased demand for electricity, and sometimes pressure on power grids. Uncoordinated charging of EVs may result in stress on distribution networks, and often some form of optimization is required in the charging process. Optimal coordinated charging is a multi-objective optimization problem (MOOP) in nature, with objective functions such as minimum price charging and minimum disruptions to the grid. In this manuscript, we propose a general multi-objective EV charging/discharging schedule (MOEVCS) framework, where the time of use (TOU) …
We describe the architecture and algorithms of the Adaptive Charging Network (ACN), which was first deployed on the Caltech campus in early 2016 and is currently operating at over 100 other sites in the United States. The architecture enables real-time monitoring and control and supports electric vehicle (EV) charging at scale. The ACN adopts a flexible Adaptive Scheduling Algorithm based on convex optimization and model predictive control and allows for significant over-subscription of electrical infrastructure. We describe some of the practical challenges in real-world charging systems, incl…
Electrification can help to reduce the carbon footprint of aviation. The transition away from jet fuel-powered conventional airplane towards battery-powered electrified aircraft will impose extra charging requirements on airports. In this paper, we first quantify the increase in energy demands at several airports across the United States (US), when commercial airline carriers partially deploy hybrid electric aircraft (HEA). We then illustrate that smart charging and minor modifications to flight schedules can substantially reduce peak power demands, and in turn the needs for grid infrastructur…
The accelerated electrification of transport systems with EVs has brought new challenges for charging scheduling, fleet management, and charging infrastructure location and configuration planning. In this review, we have provided a systematic review of the recent development in strategic, tactical, and operational decisions for demand responsive transport system planning using electric vehicles (EV-DRT). We have summarized recent developments in mathematical modeling approaches and identified future research directions. A list of existing open-access datasets, numerical test instances, and sof…
Wireless charging technology provides a solution to the insufficient battery life of electric vehicles (EVs). However, the conflict of interests between wireless charging lanes (WCLs) and EVs is difficult to resolve. In the day-ahead electricity market, considering the revenue of WCLs caused by the deviation between actual electricity sales and pre-purchased electricity, as well as endurance and traveling experience of EVs, this paper proposes a charging scheduling algorithm based on a double-layer game model. In lower layer, the potential game is used to model the multi-vehicle game of vehicl…
Coordinating the charging scheduling of electric vehicles for dynamic dial-a-ride services is challenging considering charging queuing delays and stochastic customer demand. We propose a new two-stage solution approach to handle dynamic vehicle charging scheduling to minimize the costs of daily charging operations of the fleet. The approach comprises two components: daily vehicle charging scheduling and online vehicle-charger assignment. A new battery charge scheduling model is proposed to obtain the vehicle charging schedules by minimizing the costs of vehicle daily charging operations while …
A bargaining game is investigated for cooperative energy management in microgrids. This game incorporates a fully distributed and realistic cooperative power scheduling algorithm (CoDES) as well as a distributed Nash Bargaining Solution (NBS)-based method of allocating the overall power bill resulting from CoDES. A novel weather-based stochastic renewable generation (RG) prediction method is incorporated in the power scheduling. We demonstrate the proposed game using a 4-user grid-connected microgrid model with diverse user demands, storage, and RG profiles and examine the effect of weather pr…
