Energy storage and demand-side response will play an increasingly important role in the future electricity system. We extend previous results on a single energy storage unit to the management of two energy storage units cooperating for the purpose of price arbitrage. We consider a deterministic dynamic programming model for the cooperative problem, which accounts for market impact. We develop the Lagrangian theory and present a new algorithm to identify pairs of strategies. While we are not able to prove that the algorithm provides optimal strategies, we give strong numerical evidence in favour of it. Furthermore, the Lagrangian approach makes it possible to identify decision and forecast horizons, the latter being a time beyond which it is not necessary to look in order to determine the present optimal action. In practice, this allows for real-time reoptimization, with both horizons being of the order of days.
Index Terms-control, two storage units, arbitrage, pricemaker, market impact, energy, Lagrangian.
In this paper, we propose a model of decentralized energy storages, who serve as instruments to shift energy supply intertemporally. From storages' perspective, we investigate their optimal buying or selling decisions under market uncertainty. The goal of this paper is to understand the economic value of future market information, as energy storages mitigate market uncertainty by forward-looking strategies. At a system level, we evaluate different information management policies to coordinate storages' actions and improve their aggregate profitability: (1) providing a publicly available market…
Recent studies show that the fast growing expansion of wind power generation may lead to extremely high levels of price volatility in wholesale electricity markets. Storage technologies, regardless of their specific forms e.g. pump-storage hydro, large-scale or distributed batteries, are capable of alleviating the extreme price volatility levels due to their energy usage time shifting, fast-ramping and price arbitrage capabilities. In this paper, we propose a stochastic bi-level optimization model to find the optimal nodal storage capacities required to achieve a certain price volatility level…
Energy storage can facilitate the integration of renewable energy resources by providing arbitrage and ancillary services. Jointly optimizing energy and ancillary services in a centralized electricity market reduces the system's operating cost and enhances the profitability of energy storage systems. However, achieving these objectives requires that storage be located and sized properly. We use a bi-level formulation to optimize the location and size of energy storage systems which perform energy arbitrage and provide regulation services. Our model also ensures the profitability of investments…
We show how to value both variable generation and energy storage to enable them to be integrated fairly and optimally into electricity capacity markets. We develop theory based on balancing expected energy unserved against costs of capacity procurement, and in which the optimal procurement is that necessary to meet an appropriate reliability standard. For conventional generation the theory reduces to that already in common use. Further the valuation of both variable generation and storage coincides with the traditional risk-based approach based on equivalent firm capacity. The determination of…
Reduced installation and operating costs give energy storage systems an opportunity to participate actively and profitably in electricity markets. In addition to providing ancillary services, energy storage systems can also arbitrage temporal price differences. Congestion in the transmission network often accentuates these price differences and will under certain circumstances enhance the profitability of arbitrage. On the other hand, congestion may also limit the ability of a given storage device to take advantage of arbitrage opportunities. This paper analyzes how transmission congestion aff…
Storage is expected to be a critical source of firming in low-carbon grids. A common concern raised from ex-post assessments is that storage resources can fail to respond to strong price signals during times of scarcity. While commonly attributed to forecast error or failures in operations, we posit that this behavior can be explained from the perspective of risk-averse scheduling. Using a stochastic self-scheduling framework and real-world data harvested from the Australian National Electricity Market, we demonstrate that risk-averse storage resources tend to have a myopic operational perspec…
This paper presents a millisecond-level look-ahead control algorithm for energy storage with constant space complexity and worst-case linear run-time complexity. The algorithm connects the optimal control with the Lagrangian multiplier associated with the state-of-charge constraint. It is compared to solving look-ahead control using a state-of-the-art convex optimization solver. Simulation results show that both methods obtain the same control result, while the proposed algorithm runs up to 100,000 times faster and solves most problems within one millisecond. The theoretical results from devel…
We study how storage, operating as a price maker within a market environment, may be optimally operated over an extended period of time. The optimality criterion may be the maximisation of the profit of the storage itself, where this profit results from the exploitation of the differences in market clearing prices at different times. Alternatively it may be the minimisation of the cost of generation, or the maximisation of consumer surplus or social welfare. In all cases there is calculated for each successive time-step the cost function measuring the total impact of whatever action is taken b…
Large scale electricity storage is set to play an increasingly important role in the management of future energy networks. A major aspect of the economics of such projects is captured in arbitrage, i.e. buying electricity when it is cheap and selling it when it is expensive. We consider a mathematical model which may account for nonlinear---and possibly stochastically evolving---cost functions, market impact, input and output rate constraints and both time-dependent and time-independent inefficiencies or losses in the storage process. We develop an algorithm which is maximally efficient in the…
We characterize profit-maximizing operating strategies, over some time horizon [0,T], for an energy store which is trading in an arbitrage market. Our theory allows for leakage, operating inefficiencies, operating constraints and general cost functions. In the special case where the operating cost of a store depends only on its instantaneous power output (or input), we present an algorithm to determine the optimal strategies. A key feature is that this algorithm is localized in time, in the sense that the action of the store at a time t only requires information about electricity prices over s…
The use of energy storage to balance electric grids is increasing and, with it, the importance of operational optimisation from the twin viewpoints of cost and system stability. In this paper we assess the real option value of balancing reserve provided by an energy-limited storage unit. The contractual arrangement is a series of American-style call options in an energy imbalance market (EIM), physically covered and delivered by the store, and purchased by the power system operator. We take the EIM price as a general regular one-dimensional diffusion and impose natural economic conditions on t…
Battery Energy Storage Systems (BESS) can mitigate effects of intermittent energy production from renewable energy sources and play a critical role in peak shaving and demand charge management. To optimally size the BESS from an economic perspective, the trade-off between BESS investment costs, lifetime, and revenue from utility bill savings along with microgrid ancillary services must be taken into account. The optimal size of a BESS is solved via a stochastic optimization problem considering wholesale market pricing. A stochastic model is used to schedule arbitrage services for energy storag…
In the presence of non-convexities, the power market may not have an equilibrium price for power that provides economic stability of the centralized dispatch outcome. In this case, to achieve an economically stable outcome, the uplift payments to the market players are introduced as part of the pricing principle. Given the general pricing principle that involves the lost profit compensation in the form of the uplift payments, we study a question if it is possible to introduce new products/services at the market and the associated prices such that the set of the optimal solutions to the central…
We present modeling and analysis of day-ahead spatio-temporal energy markets in which each competitive aggregator aims at making the highest profit by managing a complex mixture of different energy resources, such as conventional generators, storage batteries, and uncertain renewable resources. First, we develop an energy market model in terms of an adjustable robust convex program. This market modeling is novel in the sense that the prosumption cost function of each aggregator, which evaluates the cost to realize an amount of spatio-temporal energy prosumption, is a multi-variable function re…
This paper proposes a market mechanism for multi-interval electricity markets with generator and storage participants. Drawing ideas from supply function bidding, we introduce a novel bid structure for storage participation that allows storage units to communicate their cost to the market using energy-cycling functions that map prices to cycle depths. The resulting market-clearing process--implemented via convex programming--yields corresponding schedules and payments based on traditional energy prices for power supply and per-cycle prices for storage utilization. We illustrate the benefits of…
There is growing interest in the use of grid-level storage to smooth variations in supply that are likely to arise with increased use of wind and solar energy. Energy arbitrage, the process of buying, storing, and selling electricity to exploit variations in electricity spot prices, is becoming an important way of paying for expensive investments into grid-level storage. Independent system operators such as the NYISO (New York Independent System Operator) require that battery storage operators place bids into an hour-ahead market (although settlements may occur in increments as small as 5 minu…
Energy storage technologies are key to improving grid flexibility in the presence of increasing amounts of intermittent renewable generation. We propose an insurance contract that suitably compensates energy storage systems for providing flexibility. Such a contract provides a wider range of market opportunities for these systems while also incentivizing higher renewable penetration in the grid. We consider a day-ahead market in which generators, including renewables and storage owners, bid to be scheduled for the next operating day. Due to production uncertainty, renewable generators may be u…
University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Virginia Tech（弗吉尼亚理工学院暨州立大学）；South China University of Technology（华南理工大学）
In this letter, we address the problem of controlling energy storage systems (ESSs) for arbitrage in real-time electricity markets under price uncertainty. We first formulate this problem as a Markov decision process, and then develop a deep reinforcement learning based algorithm to learn a stochastic control policy that maps a set of available information processed by a recurrent neural network to ESSs' charging/discharging actions. Finally, we verify the effectiveness of our algorithm using real-time electricity prices from PJM.
There is an intrinsic value in higher integration of multi-carrier energy systems (especially gas and electricity), to increase operational flexibility in the electricity system and to improve allocation of resources in gas and electricity networks. The integration of different energy carrier markets is challenging due to the existence of physical and economic dependencies between the different energy carriers. We propose in this paper an integrated day-ahead multi-carrier gas, electricity and heat market clearing which includes new types of orders and constraints on these orders to represent …
Ambitious renewable portfolio standards motivate the incorporation of energy storage resources (ESR) as sources of flexibility. While the United States government aims to promote ESR participation in electricity markets, work on market designs for properly remunerating ESRs is still lacking. In this paper, we propose a new energy market clearing framework that incorporates ESR systems. The new market design is computationally attractive in that it avoids mixed-integer formulations and formulations with complementarity constraints. Moreover, compared to previous market designs, our market decom…
We investigate the problem of characterizing the economic value of energy storage capacity to a wind power producer (WPP) that sells its energy in a conventional two-settlement electricity market. The WPP can offer a forward contract to supply power in the day-ahead market, subject to financial penalties for imbalances between the contracted power and the power that is delivered in real-time. We consider the setting in which the WPP has access to a co-located energy storage system, and can thus reshape its wind power production subject to its storage capacity constraints. Modeling wind power a…
Lagrangian Relaxation for Continuous-Time Optimal Control of Coupled Hydrothermal Power Systems Including Storage Capacity and a Cascade of Hydropower Systems with Time Delays
When participating in electricity markets, owners of battery energy storage systems must bid in such a way that their revenues will at least cover their true cost of operation. Since cycle aging of battery cells represents a substantial part of this operating cost, the cost of battery degradation must be factored in these bids. However, existing models of battery degradation either do not fit market clearing software or do not reflect the actual battery aging mechanism. In this paper we model battery cycle aging using a piecewise linear cost function, an approach that provides a close approxim…
Interest in sustainability has increased the share of variable renewable energy sources (VRES) in power generation. Energy storage systems' potential to mitigate intermittencies from non-dispatchable VRES has enhanced their appeal. However, the impacts of storage vary based on the owner and market conditions. We examine the policy implications of investments in utility-scale battery storage via a bi-level optimization model. The lower level depicts power system operations, modeled as either perfect competition or Cournot oligopoly to allow for the assessment of producer market power. The upper…
In this work, we analyze the spatio-temporal economic properties of multi-product supply chains. Specifically, we interpret the supply chain as a coordinated market in which stakeholders (suppliers, consumers, and providers of transportation, storage, and transformation services) bid into a market that is cleared by an independent entity to obtain allocations and prices. The proposed model provides a general graph representation of spatio-temporal product transport that helps capture geographical transport, time delays, and storage (temporal transport) in a unified and compact manner. This rep…
There has recently been growing interest in the development of financial storage rights for energy storage systems as instruments akin to their transmission counterparts as a means to not only distribute congestion rents, but also to mitigate price risks, and even to signal and finance investments in light of increasing penetration of renewable generation and downward pressures on market clearing prices. This work presents a discussion on the applicability of such instruments to hydroelectric power plants as a mechanism to decouple ownership and operation of reservoirs, especially those with s…
Approximate Dynamic Programming for Degradation-aware Market Participation of Battery Energy Storage Systems: Bridging Market and Degradation Timescales
The decreasing cost of energy storage technologies coupled with their potential to bring significant benefits to electric power networks have kindled research efforts to design both market and regulatory frameworks to facilitate the efficient construction and operation of such technologies. In this paper, we examine an open access approach to the integration of storage, which enables the complete decoupling of a storage facility's ownership structure from its operation. In particular, we analyze a nodal spot pricing system built on a model of economic dispatch in which storage is centrally dis…
It is anticipated that large-scale energy storage facility (ESF) will become an essential part of the future energy markets to increase the penetration of renewables. In this paper, a new optimization algorithm is developed to participate in large-scale merchant ESF to deal with renewables fluctuations. The ESF is an investor-owned and independently-operated, seeking to maximize its total profit while hedging the system against net-load variation. To do so, an exact computationally efficient bi-level mixed-integer linear programming (MILP) is envisaged. The ESF operator tries to maximize its o…
Energy storage is a key enabler towards a low-emission electricity system, but requires appropriate dispatch models to be economically coordinated with other generation resources in bulk power systems. This paper analyzes how different dispatch models and bidding strategies would affect the utilization of storage with various durations in deregulated power systems. We use a dynamic programming model to calculate the operation opportunity value of storage from price predictions, and use the opportunity value result as a base for designing market bids. We compare two market bidding and dispatch …
It is likely that electricity storage will play a significant role in the balancing of future energy systems. A major challenge is then that of how to assess the contribution of storage to capacity adequacy, i.e. to the ability of such systems to meet demand. This requires an understanding of how to optimally schedule multiple storage facilities. The present paper studies this problem in the cases where the objective is the minimisation of expected energy unserved (EEU) and also a form of weighted EEU in which the unit cost of unserved energy is higher at higher levels of unmet demand. We also…
