arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.12911eess.SYcs.SY
收藏

高比例可再生能源电力系统的广域反馈控制:强化学习与基于李雅普诺夫设计的比较研究

Wide-Area Feedback Control for Renewables-Heavy Power Systems: A Comparative Study of Reinforcement Learning and Lyapunov-Based Design

Vanderbilt University(范德堡大学)

Muhammad Nadeem, MirSaleh Bahavarnia, Ahmad F. Taha

AI总结:

针对高比例可再生能源电力系统的广域反馈控制问题,本文对比了无模型强化学习方法与带稳定性保证的基于李雅普诺夫的模型驱动方法,通过理论分析与案例研究明确了两类方法的优劣势。

摘要:

随着可再生能源普及率不断提升,电网动态特性的精准建模复杂度日益增加;与此同时,控制中心的数据采集与系统状态实时监测能力持续增强,这推动反馈控制器设计从基于模型与李雅普诺夫的范式向无模型范式转型。强化学习(RL)已成为设计无模型控制器的核心工具,目前已有多项研究探索基于RL的电压/频率控制策略,但这类研究通常采用简化系统模型,忽略太阳能、风电与复合负荷的详细动态特性,也普遍未考虑全系统振荡阻尼与潮流建模问题。为此,本文针对由一组非线性微分代数方程(NDAE)描述的精细化高比例可再生能源电力系统,构建了最优反馈控制问题,分别采用完全无模型的RL方法、以及基于李雅普诺夫稳定性理论且具备稳定性保证的基于模型方法求解该控制问题。本文核心旨在探究电网场景下数据驱动反馈控制是否应替代模型驱动方案,围绕该目标开展了理论推导与全面的案例研究,最终详细分析了两类方法应用于高比例可再生能源电网的优势与不足。

英文摘要:

As renewable energy sources become more prevalent, accurately modeling power grid dynamics is becoming increasingly more complex. Concurrently, data acquisition and realtime system state monitoring are becoming more available for control centers. This motivates shifting from \textit{model- and Lyapunov-based} feedback controller designs toward \textit{model-free} ones. Reinforcement learning (RL) has emerged as a key tool for designing model-free controllers. Various studies have been carried out to study voltage/frequency control strategies via RL. However, usually a simplified system model is used neglecting detailed dynamics of solar, wind, and composite loads -- and damping system-wide oscillations and modeling power flows are all usually ignored. To that end, we pose an optimal feedback control problem for a detailed renewables-heavy power system, defined by a set of nonlinear differential algebraic equations (NDAE). The control problem is solved using a completely model-free design via RL as well as using a model-based approach built upon the Lyapunov stability theory with guarantees. The paper in its essence seeks to explore whether data-driven feedback control should be used in power grids over its model-driven counterpart. Theoretical developments and thorough case studies are presented with an eye on this exploration. Finally, a detailed analysis is provided to delineate the strengths and weaknesses of both approaches for renewables-heavy grids.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑