Renewable power sources have low production costs, but may result in high balancing costs due to the inherent production uncertainty. Current day-ahead markets elicit only point production profiles and neglect the degree of uncertainty associated with each generating asset, preventing the market operator from accounting for balancing costs in day-ahead dispatch and ancillary service procurement. This increases the total system cost and undermines market efficiency, especially in renewable-heavy power systems. To address this, we propose a new market clearing paradigm based on a two-stage mechanism, where producers report their production forecast distribution in the day-ahead stage, followed by the realized production in the real-time stage. By extending the Vickrey-Clarke-Groves (VCG) payments to the two-stage setting, we show appealing properties in terms of incentive compatibility and individual rationality. An electricity market case study validates the theoretical claims, illustrating the effectiveness of the proposed mechanism in reducing system cost.
The proposed open-source Power Market Tool (POMATO) aims to enable research on interconnected modern and future electricity markets in the context of the physical transmission system and its secure operation. POMATO has been designed to study capacity allocation and congestion management (CACM) policies of European zonal electricity markets, especially flow-based market coupling (FBMC). For this purpose, POMATO implements methods for the analysis of simultaneous zonal market clearing, nodal (N-k secure) power flow computation for capacity allocation, and multi-stage market clearing with adapti…
We propose a new forward electricity market framework that admits heterogeneous market participants with second-order cone strategy sets, who accurately express the nonlinearities in their costs and constraints through conic bids, and a network operator facing conic operational constraints. In contrast to the prevalent linear-programming-based electricity markets, we highlight how the inclusion of second-order cone constraints improves uncertainty-, asset- and network-awareness of the market, which is key to the successful transition towards an electricity system based on weather-dependent ren…
Recently, chance-constrained stochastic electricity market designs have been proposed to address the shortcomings of scenario-based stochastic market designs. In particular, the use of chance-constrained market-clearing avoids trading off in-expectation and per-scenario characteristics and yields unique energy and reserves prices. However, current formulations rely on symmetric control policies based on the aggregated system imbalance, which restricts balancing reserve providers in their energy and reserve commitments. This paper extends existing chance-constrained market-clearing formulations…
The implementation of electricity markets based on locational marginal pricing in a multi-settlement process has allowed wholesale competition, with pricing mechanisms that incentivize the optimal allocation of generation, transmission, and demand-response resources. While efficiency and reliability gains have been achieved in the US at a regional level, the lack of adequate inter-regional coordination mechanisms has limited broader gains. The shortcomings of cross-border coordination of electricity markets become more apparent as the industry transitions towards higher penetration of renewabl…
Existing electricity market designs assume risk neutrality and lack risk-hedging instruments, which leads to suboptimal market outcomes and reduces the overall market efficiency. This paper enables risk-trading in the chance-constrained stochastic electricity market by introducing Arrow-Debreu Securities (ADS) and derives a risk-averse market-clearing model with risk trading. To enable risk trading, the probability space of underlying uncertainty is discretized in a finite number of outcomes, which makes it possible to design practical risk contracts and to produce energy, balancing reserve an…
An Electricity Market with Reactive Power Trading: Incorporating Dynamic Operating Envelopes
Australian National University（澳大利亚国立大学）；Monash University（莫纳什大学）；University of Melbourne（墨尔本大学）；The University of Sydney（悉尼大学）；University of California, Berkeley（加利福尼亚大学伯克利分校）
A multiple market trading mechanism for the VPP to participate in electricity, renewable energy certificate (REC) and carbon emission right (CER) markets is proposed. With the introduction of the inventory mechanism of REC and CER, the profit of the VPP increases and better trading decisions with multiple markets are made under the requirements of renewable portfolio standard (RPS) and carbon emission (CE) quota requirements. According to the Karush-Kuhn-Tucker (KKT) conditions of the proposed model, properties of the multiple market trading mechanism are discussed. Results from case studies v…
Renewable power to ammonia (RePtA) is a prominent zero-carbon pathway for decarbonization. Due to the imbalance between renewables and production energy demand, the RePtA system relies on the electricity exchange with the power grid. Participating in the electricity market as a virtual power plant (VPP) may help to reduce energy costs. However, the power profile of local photovoltaics and wind turbines is similar to those in the market, resulting in rising energy costs under the conventional strategy. Hence, we develop a multi-timescale trading strategy for the RePtA VPP in the electricity, hy…
The decarbonization of the power sector plays a pivotal role in economy-wide decarbonization to set the world on track to limit warming to 1.5°C by 2050. Carbon emission markets can play a significant role in this transition by putting a price on carbon and giving electricity producers an incentive to reduce their emissions. In this paper, we study the operational equilibrium of an integrated regional/jurisdictional energy system that comprises an electricity market, a natural gas market, and a carbon emission market. We first propose the novel role of a regional carbon market operator (CMO). …
The increasing trend of transportation electrification presents investors the opportunity to provide charging services to Electric Vehicle (EV) owners via the energy purchased from the wholesale electricity market. This will benefit EV owners with the availability of competitive rates compared to the regulated utility time-of-use (TOU) rates. The fundamental questions addressed in this paper are 1) will EV owners benefit from the additional choice of Electric Vehicle Charging Stations (EVCSs) compared to home charging? 2) is there any profitable market opportunity for charging stations while t…
Coordinating the operation of units at the interface between heat and electricity systems, such as combined heat and power plants and heat pumps, is essential to reduce inefficiencies in each system and help achieve a cost-effective and efficient operation of the overall energy system. These energy systems are currently operated by sequential markets, which interface the technical and economic aspects of the systems. In that context, this study introduces an electricity-aware heat unit commitment model, which seeks to optimize the operation of the heat system while accounting for the techno-ec…
Efficiently accommodating uncertain renewable resources in wholesale electricity markets is among the foremost priorities of market regulators in the US, UK and EU nations. However, existing deterministic market designs fail to internalize the uncertainty and their scenario-based stochastic extensions are limited in their ability to simultaneously maximize social welfare and guarantee non-confiscatory market outcomes in expectation and per each scenario. This paper proposes a chance-constrained stochastic market design, which is capable of producing a robust competitive equilibrium and interna…
Over the last few decades, electricity markets around the world have adopted multi-settlement structures, allowing for balancing of supply and demand as more accurate forecast information becomes available. Given increasing uncertainty due to adoption of renewables, more recent market design work has focused on optimization of expectation of some quantity, e.g. social welfare. However, social planners and policy makers are often risk averse, so that such risk neutral formulations do not adequately reflect prevailing attitudes towards risk, nor explain the decisions that follow. Hence we incorp…
The intraday (ID) electricity market has received an increasing attention in the recent EU electricity-market discussions. This is partly because the uncertainty in the underlying power system is growing and the ID market provides an adjustment platform to deal with such uncertainties. Hence, market participants need a proper ID market price model to optimally adjust their positions by trading in the market. Inadequate historical data for ID market price makes it more challenging to model. This paper proposes long short-term memory, deep convolutional generative adversarial networks, and No-U-…
In September 2018 EirGrid launched the new electricity market. These new market arrangements integrate the all island electricity market with European electricity markets, making optimal use of cross border transmission assets. Ireland operates three operational HVDC interconnectors: Moyle, East-West, and Greenlink and one in development Celtic interconnector which connect Ireland to Scotland, Wales, and France respectively. Irish market operator, EirGrid, can maximize their operational profit by using the price difference in these electricity markets. We propose a profit maximization modellin…
Should the organization, design and functioning of electricity markets be taken for granted? Definitely not. While decades of evolution of electricity markets in countries that committed early to restructure their electric power sector made us believe that we may have found the right and future-proof model, the substantially and rapidly evolving context of our power and energy systems is challenging this idea in many ways. Actually, that situation brings both challenges and opportunities. Challenges include accommodation of renewable energy generation, decentralization and support to investmen…
In this paper, we propose a bilateral peer-to-peer (P2P) energy trading scheme for residential prosumers with a simplified entry to the market. We formulate the market as an assignment game, a special class of coalitional games. For solving the resulting decision problem, we design a bilateral negotiation mechanism that enables matched buyer-seller pairs to reach a consensus on a set of ``stable" and ``fair" trading contracts. The proposed negotiation process can be executed on possibly time-varying communication networks with virtually minimal information requirements that in turn preserves p…
Maintaining the stability of renewable-dominant power systems requires the procurement of virtual inertia services from non-synchronous resources (e.g., batteries, wind turbines) in addition to inertia traditionally provided by synchronous resources (e.g., thermal generators). However, the pricing of inertia provision has not been studied in a stochastic electricity market, where the uncertainty characteristics of renewable energy sources (RES) are considered. To fill in this research gap, this paper formulates a chance-constrained stochastic unit commitment model with inertia requirements and…
The ambitious CO2 emission targets of the Paris agreements are achievable only with renewable energy, CO2-free power generation, new policies, and planning. The main motivation of this paper is that future green fuels from power-to-X assets should be produced from power with the lowest possible emissions while still keeping the cost of electricity low. To this end we propose a power-to-X scheduling framework that is capable of co-optimizing CO2 emission intensity and electricity prices in the day-ahead electricity market scheduling. Three realistic models for local production units are develop…
Towards the Interactive Effects of Demand Response Participation on Electricity Spot Market Price
Energy Production and Infrastructure Center (EPIC)（能源生产与基础设施中心）；Belk College of Business（贝尔克商学院）；University of North Carolina at Charlotte（北卡罗来纳大学夏洛特分校）
The Regional Transmission Operators each have unique methods to procure frequency regulation reserves used to track real power fluctuations on the grid. Some market clearing practices result in high regulation prices with large spread compared to other markets. We present the frequency regulation market clearing formulations--as derived from operator tariffs--of the ISO New England, PJM Interconnection, and Midcontinent ISO. We offer test case examples to explain the historic market pricing behavior seen within each system operator and conclude this behavior is due to the inclusion of estimate…
Sector coordination between heat and electricity systems has been identified has an energy-efficient and cost-effective way to transition towards a more sustainable energy system. However, the coordination of sequential markets relies on the exchange of sensitive information between the market operators, namely time series of consumers' loads. To address the privacy concerns arising from this exchange, this paper introduces a novel privacy-preserving Stackelberg mechanism (w-PPSM) which generates differentially-private data streams with high fidelity. The proposed w-PPSM enforces the feasibili…
University of California San Diego（加州大学圣地亚哥分校）；San Diego State University（圣地亚哥州立大学）
In this paper, statistical machine learning algorithms, as well as deep neural networks, are used to predict the values of the price gap between day-ahead and real-time electricity markets. Several exogenous features are collected and impacts of these features are examined to capture the best relations between the features and the target variable. Ensemble learning algorithm namely the Random Forest issued to calculate the probability distribution of the predicted electricity prices for day-ahead and real-time markets. Long-Short-Term-Memory (LSTM) is utilized to capture long term dependencies…
Arbitrage is one important revenue source for energy storage in electricity markets. However, a large amount of storage in the market will impact the energy price and reduce potential revenues. This can lead to strategic behaviors of profit-seeking storage investors. To study the investors' strategic storage investments, we formulate a non-cooperative game between competing investors. Each investor decides the storage investment over a long investment horizon, and operates the storage for arbitrage revenues in the daily electricity market. Different investors can deploy storage with different …
Solving the optimal power flow (OPF) problem in real-time electricity market improves the efficiency and reliability in the integration of low-carbon energy resources into the power grids. To address the scalability and adaptivity issues of existing end-to-end OPF learning solutions, we propose a new graph neural network (GNN) framework for predicting the electricity market prices from solving OPFs. The proposed GNN-for-OPF framework innovatively exploits the locality property of prices and introduces physics-aware regularization, while attaining reduced model complexity and fast adaptivity to…
Market power exercise in the electricity markets distorts market prices and diminishes social welfare. Many markets have implemented market power mitigation processes to eliminate the impact of such behavior. The design of mitigation mechanisms has a direct influence on investors' profitability and thus mid-/long-term resource adequacy. In order to evaluate the effectiveness of the existing market power mitigation mechanisms, this paper proposes a mitigation-aware strategic bidding model and studies the bidding strategies of the market participants under current practice. The proposed bidding …
We consider a two-stage market mechanism for trading electricity including renewable generation as an alternative to the widely used multi-settlement market structure. The two-stage market structure allows for recourse decisions by the market operator, which are not possible in today's markets. We allow for different conventional generation cost curves in the forward and the real-time stages. We have considered costs of demand response programs and black outs, and adopt a DC power flow model to account for network constraints. Our first result is to show existence (by construction) of a sequen…
Prosumer operators are dealing with extensive challenges to participate in short-term electricity markets while taking uncertainties into account. Challenges such as variation in demand, solar energy, wind power, and electricity prices as well as faster response time in intraday electricity markets. Machine learning approaches could resolve these challenges due to their ability to continuous learning of complex relations and providing a real-time response. Such approaches are applicable with presence of the high performance computing and big data. To tackle these challenges, a Markov decision …
Tie-line scheduling in multi-area power systems in the US largely proceeds through a market-based mechanism called Coordinated Transaction Scheduling (CTS). We analyze this market mechanism through a game-theoretic lens. Our analysis characterizes the effect of market liquidity, market participants' forecasts about inter-area price spreads, transactions fees and coupling of CTS markets with up-to-congestion virtual transactions. Using real data, we empirically verify that CTS bidders can employ simple learning algorithms to discover Nash equilibria that support the conclusions drawn from equil…
Ambitious renewable portfolio standards motivate the incorporation of energy storage resources (ESR) as sources of flexibility. While the United States government aims to promote ESR participation in electricity markets, work on market designs for properly remunerating ESRs is still lacking. In this paper, we propose a new energy market clearing framework that incorporates ESR systems. The new market design is computationally attractive in that it avoids mixed-integer formulations and formulations with complementarity constraints. Moreover, compared to previous market designs, our market decom…
A Few-Shot LLM Framework for Extreme Day Classification in Electricity Markets
Columbia Data Science Institute（哥伦比亚数据科学研究所）；Red River Clean Energy（红河清洁能源）；King Abdulaziz City for Science and Technology (KACST)（国王阿卜杜勒阿齐兹城市科学技术城）；National Science Foundation（国家科学基金会）
This paper presents a framework to solve the strategic bidding problem of participants in an electricity market cleared by employing the full AC Optimal Power Flow (ACOPF) problem formulation. Traditionally, the independent system operators (ISOs) leveraged DC Optimal Power Flow (DCOPF) problem formulation to settle the electricity market. The main quest of this work is to find what would be the challenges and opportunities if ISOs leverage the full ACOPF as the market-clearing Problem (MCP)? This paper presents tractable mathematical programming with equilibrium constraints for the convexifie…
Despite extensive research in the past five years and several successfully completed and on-going pilot projects, regulators are still reluctant to implement peer-to-peer trading at a large-scale in today's electricity market. The reason could partly be attributed to the perceived disadvantage of current market participants like retailers due to their exclusion from market participation - a fundamental property of decentralised peer-to-peer trading. As a consequence, recently, there has been growing pressure from energy service providers in favour of retailers' participation in peer-to-peer tr…
