Integrating Distributed Energy Resources (DERs) with peer-to-peer (P2P) energy trading offers promising solutions for grid modernization by incentivizing prosumers to participate in mitigating peak demand. However, this integration also introduces operational uncertainties and computational challenges. This paper aims to address these challenges with a novel scalable and tractable distributionally robust joint chance-constrained (DRJCC) optimization framework that effectively facilitates P2P energy trading by enhancing flexibility provision from large-scale DER operations under uncertain supply and demand. Therefore, a practical framework is proposed to solve the core challenges of DRJCC by integrating three key components: (1) a Wasserstein ambiguity set that effectively quantifies uncertainty with sparse data, (2) a CVaR-based approximation of joint chance constraints to balance computational efficiency with risk control, and (3) a privacy-preserving ADMM algorithm that enables distributed implementation through decomposition. To discern patterns in the data that indicate collaboration potential and adjust ambiguity sets for improved efficiency, K-means clustering is applied to historical scenarios. Simulation results show that the proposed framework reduces peak demand by approximately 28% and total community costs by around 31%, underscoring its effectiveness in enhancing grid robustness, operational reliability, and economic optimization in renewable-based energy management.
Renewable energy generation is offered through electricity markets, quite some time in advance. This then leads to a problem of decision-making under uncertainty, which may be seen as a newsvendor problem. Contrarily to the conventional case for which underage and overage penalties are known, such penalties in the case of electricity markets are unknown, and difficult to estimate. In addition, one is actually only penalized for either overage or underage, not both. Consequently, we look at a slightly different form of a newsvendor problem, for a price-taker participant offering in electricity …
Power systems are shifted from conventional bulk generation toward renewable generation. This trend leads to the frequency security problem due to the decline of system inertia. On the other hand, natural gas-fired units are frequently scheduled to provide operational flexibility due to their fast adjustment ability. The interdependence between power and natural gas systems is thus intensified. In this paper, we study the frequency constrained scheduling problem from the perspective of an integrated electricity-gas system under variable wind power. We propose a distributionally robust (DR) cha…
This paper considers a security constrained dispatch problem involving generation and line contingencies in the presence of the renewable generation. The uncertainty due to renewables is modeled using joint chance-constraint and the mismatch caused by contingencies and renewables are handled using reserves. We consider a distributionally robust approach to solve the chance-constrained program. We assume that samples of the uncertainty are available. Using them, we construct a set of distributions, termed ambiguity set, containing all distributions that are close to the empirical distribution u…
Energy storage technologies are key to improving grid flexibility in the presence of increasing amounts of intermittent renewable generation. We propose an insurance contract that suitably compensates energy storage systems for providing flexibility. Such a contract provides a wider range of market opportunities for these systems while also incentivizing higher renewable penetration in the grid. We consider a day-ahead market in which generators, including renewables and storage owners, bid to be scheduled for the next operating day. Due to production uncertainty, renewable generators may be u…
Increasing integration of renewable generation poses significant challenges to ensure robustness guarantees in real-time energy system decision-making. This work aims to develop a robust optimal transmission switching (OTS) framework that can effectively relieve grid congestion and mitigate renewable curtailment. We formulate a two-stage distributionally robust chance-constrained (DRCC) problem that assures limited constraint violations for any uncertainty distribution within an ambiguity set. Here, the second-stage recourse variables are represented as linear functions of uncertainty, yieldin…
To address the challenge of the renewable energy uncertainty, the ISO New England (ISO-NE) has proposed to apply do-not-exceed (DNE) limits, which represent the maximum nodal injection of renewable energy the grid can accommodate. Unfortunately, it appears challenging to compute DNE limits that simultaneously maintain the system flexibility and incorporate a large portion of the available renewable energy at the minimum cost. In addition, it is often challenging to accurately estimate the joint probability distribution of the renewable energy. In this paper, we propose a two-stage distribution…
The increased market penetration of renewable energy sources and the rapid development of electric battery storage technologies yield a potential for reducing electricity price volatility while maintaining stability of the power grid. This work presents an algorithmic approach to control battery levels and forward positions to optimally manage power output fluctuations caused by intermittent renewable energy generation. This paper will also explore the effect of battery technology on the firm's optimal trading behaviour in the electricity spot market.
Energy Management for Renewable-Colocated Artificial Intelligence Data Centers
School of Electrical and Computer Engineering, Cornell University(电气与计算机工程系,康奈尔大学);Dyson School of Applied Economics and Management, Cornell University(应用经济学与管理学院,康奈尔大学)
Over the last few decades, electricity markets around the world have adopted multi-settlement structures, allowing for balancing of supply and demand as more accurate forecast information becomes available. Given increasing uncertainty due to adoption of renewables, more recent market design work has focused on optimization of expectation of some quantity, e.g. social welfare. However, social planners and policy makers are often risk averse, so that such risk neutral formulations do not adequately reflect prevailing attitudes towards risk, nor explain the decisions that follow. Hence we incorp…
Starting from the model in Koch-Vargiolu (2019), we test the real impact of current renewable installed power in the electricity price in Italy, and assess how much the renewable installation strategy which was put in place in Italy deviated from the optimal one obtained from the model in the period 2012--2018. To do so, we consider the Ornstein-Uhlenbeck (O-U) process, including an exogenous increasing process influencing the mean reverting term, which is interpreted as the current renewable installed power. Using real data of electricity price, photovoltaic and wind energy production from th…
We develop a model for the industry dynamics in the electricity market, based on mean-field games of optimal stopping. In our model, there are two types of agents: the renewable producers and the conventional producers. The renewable producers choose the optimal moment to build new renewable plants, and the conventional producers choose the optimal moment to exit the market. The agents interact through the market price, determined by matching the aggregate supply of the two types of producers with an exogenous demand function. Using a relaxed formulation of optimal stopping mean-field games, w…
At present, electricity markets largely ignore the fact that renewable power producers impose significant externalities on non-renewable energy producers. This is because consumers are generally guaranteed electricity within certain load parameters. The intermittent nature of production by renewable energy producers implies that they rely on non-renewable producers so that the aggregate power delivered meets the promised quality of service. This implicit insurance provided by the non-renewable power sector to consumers is not currently priced and leads to an often ignored, hidden monetary tran…
We consider the problem of look-ahead economic dispatch (LAED) with uncertain renewable energy generation. The goal of this problem is to minimize the cost of conventional energy generation subject to uncertain operational constraints. The risk of violating these constraints must be below a given threshold for a family of probability distributions with characteristics similar to observed past data or predictions. We present two data-driven approaches based on two novel mathematical reformulations of this distributionally robust decision problem. The first one is a tractable convex program in w…
This paper proposes a distributionally robust unit commitment approach for microgrids under net load and electricity market price uncertainty. The key thrust of the proposed approach is to leverage the Kullback-Leibler divergence to construct an ambiguity set of probability distributions and formulate an optimization problem that minimizes the expected costs brought about by the worst-case distribution in the ambiguity set. The proposed approach effectively exploits historical data and capitalizes on the k-means clustering algorithm, in conjunction with the soft dynamic time warping score, to …
To manage renewable generation and load consumption uncertainty, chance-constrained optimal power flow (OPF) formulations and various solution methodologies have been proposed. However, conventional solution approaches often rely on accurate estimates of uncertainty distributions, which may not exist. When the distributions are not known but can be limited to a set of plausible distributions, termed an ambiguity set, distributionally robust (DR) optimization can be used to ensure that chance constraints hold for all distributions in that set. However, DR OPF yields conservative solutions if th…
The fluctuations of electricity prices in demand response schemes and intermittency of renewable energy supplies necessitate the adoption of energy storage in microgrids. However, it is challenging to design effective real-time energy storage management strategies that can deliver assured optimality, without being hampered by the uncertainty of volatile electricity prices and renewable energy supplies. This paper presents a simple effective online algorithm for the charging and discharging decisions of energy storage that minimizes the electricity cost in the presence of electricity price fluc…
Aggregators are playing an increasingly crucial role in the integration of renewable generation in power systems. However, the intermittent nature of renewable generation makes market interactions of aggregators difficult to monitor and regulate, raising concerns about potential market manipulation by aggregators. In this paper, we study this issue by quantifying the profit an aggregator can obtain through strategic curtailment of generation in an electricity market. We show that, while the problem of maximizing the benefit from curtailment is hard in general, efficient algorithms exist when t…
This paper proposes a new optimization model and solution method for determining optimal locations and sizing of renewable energy sources and hydrogen storage in a power network. We obtain these strategic decisions based on the multi-period alternating current optimal power (AC OPF) flow problem that considers the uncertainty of renewable output, electricity demand, and electricity prices. We develop a second-order cone programming approach within a Benders decomposition framework to provide globally optimal solutions. To the best of our knowledge, our paper is the first to propose a systemati…
In countries with an extended use of district heating (DH), the integrated operation of DH and power systems can increase the flexibility of the power system achieving a higher integration of renewable energy sources (RES). DH operators can not only provide flexibility to the power system by acting on the electricity market, but also profit from the situation to lower the overall system cost. However, the operational planning and bidding includes several uncertain components at the time of planning: electricity prices as well as heat and power production from RES. In this publication, we propo…
Two-stage robust unit commitment (RUC) models have been widely used for day-ahead energy and reserve scheduling under high renewable integration. The current state of the art relies on budget-constrained polyhedral uncertainty sets to control the conservativeness of the solutions. The associated lack of interpretability and parameter specification procedures, as well as the high computational burden exhibited by available exact solution techniques call for new approaches. In this work, we use an alternative scenario-based framework whereby uncertain renewable generation is characterized by a p…
This paper studies the problem of stochastic dynamic pricing and energy management policy for electric vehicle (EV) charging service providers. In the presence of renewable energy integration and energy storage system, EV charging service providers must deal with multiple uncertainties --- charging demand volatility, inherent intermittency of renewable energy generation, and wholesale electricity price fluctuation. The motivation behind our work is to offer guidelines for charging service providers to determine proper charging prices and manage electricity to balance the competing objectives o…
The natural gas and electricity systems are now becoming more and more strongly coupled. While gas-fired units (GFUs) are replacing the retired coal plants, the power systems are also increasingly dependent on the flexibilities provided by GFUs to accommodate intermittent renewable energies. The GFUs' capability of power generation relies on the availability of gas resources, which is determined jointly by the capacity of gas suppliers and their associated pipeline networks. However, the gas and electricity markets are operated separately. As a con-sequence, the GFUs actually have to "represen…
In electricity markets with a dual-pricing scheme for balancing energy, controllable production units typically participate in the balancing market as "active" actors by offering regulating energy to the system, while renewable stochastic units are treated as "passive" participants that create imbalances and are subject to less competitive prices. Against this background, we propose an innovative market framework whereby the participant in the balancing market is allowed to act as an active agent (i.e., a provider of regulating energy) in some trading intervals and as a passive agent (i.e., a …
The expected increase in the penetration of renewables in the approaching decade urges the electricity market to introduce new products - in particular, flexible ramping products - to accommodate the renewables' variability and intermittency. CAISO and MISO are leading the design of the new products. However, it is not clear how such products may affect the electricity market. In this paper, we are specifically interested in assessing how the new products distort the optimal energy dispatch by comparing with the case without such products. The distortion may impose additional cost, which we te…
The problem of dynamic pricing of electricity in a retail market is considered. A Stackelberg game is used to model interactions between a retailer and its customers; the retailer sets the day-ahead hourly price of electricity and consumers adjust real-time consumptions to maximize individual consumer surplus. For thermostatic demands, the optimal aggregated demand is shown to be an affine function of the day-ahead hourly price. A complete characterization of the trade-offs between consumer surplus and retail profit is obtained. The Pareto front of achievable trade-offs is shown to be concave,…
The problem of integrating renewables and storage into a distribution network is considered under two integration models: (i) a centralized model involving a retail utility that owns the integration as part of its portfolio of energy resources, and (ii) a decentralized model in which each consumer individually owns and operates the integration and is capable of selling surplus electricity back to the retailer in a net-metering setting. The two integration models are analyzed using a Stackelberg game in which the utility is the leader in setting the retail price of electricity, and each consume…