arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.04374eess.SYcs.AIcs.SY
收藏

基于深度强化学习的非线性电力系统无模型负荷频率控制

Model-Free Load Frequency Control of Nonlinear Power Systems Based on Deep Reinforcement Learning

School of Cyber Science and Engineering, Xi’an Jiaotong University(西安交通大学网络空间安全学院);College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);School of Astronautics, Harbin Institute of Technology(哈尔滨工业大学航天学院)

Xiaodi Chen, Meng Zhang, Zhengguang Wu, Ligang Wu, Xiaohong Guan

AI总结:

针对现有负荷频率控制依赖精确建模、忽略非线性特性的问题,提出基于DDPG框架的无模型LFC方法,通过仿真器网络评估动作、结合ZOO与反向传播优化控制器,对非线性电力系统适应性更强。

摘要:

负荷频率控制(LFC)被广泛应用于电力系统中,用于稳定频率波动并保证电能质量。然而,现有大多数LFC方法依赖于精确的电力系统建模,且通常忽略系统的非线性特性,限制了控制器的性能。为解决这些问题,本文提出一种基于深度确定性策略梯度(DDPG)框架的非线性电力系统无模型LFC方法。该方法构建了一个仿真器网络来模拟电力系统动态特性。在定义动作-价值函数后,采用仿真器网络而非评论家网络来评估控制动作。随后通过基于零阶优化(ZOO)和反向传播算法估计策略梯度,有效优化行动者网络控制器。仿真结果及相应对比表明,所设计的控制器能够生成合适的控制动作,且对非线性电力系统具有较强的适应性。

英文摘要:

Load frequency control (LFC) is widely employed in power systems to stabilize frequency fluctuation and guarantee power quality. However, most existing LFC methods rely on accurate power system modeling and usually ignore the nonlinear characteristics of the system, limiting controllers' performance. To solve these problems, this paper proposes a model-free LFC method for nonlinear power systems based on deep deterministic policy gradient (DDPG) framework. The proposed method establishes an emulator network to emulate power system dynamics. After defining the action-value function, the emulator network is applied for control actions evaluation instead of the critic network. Then the actor network controller is effectively optimized by estimating the policy gradient based on zeroth-order optimization (ZOO) and backpropagation algorithm. Simulation results and corresponding comparisons demonstrate the designed controller can generate appropriate control actions and has strong adaptability for nonlinear power systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑