arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.14186eess.SYcs.SY
收藏

基于障碍函数的电力系统紧急控制安全强化学习

Barrier Function-based Safe Reinforcement Learning for Emergency Control of Power Systems

Thanh Long Vu, Sayak Mukherjee, Renke Huang, Qiuhua Hung

摘要:

低压减载已被认为是在紧急和严重情况下恢复电网电压稳定的标准和有效措施。然而,这种方案通常会使大量的负载跳闸,这对客户来说是不必要的和有害的。最近,深度强化学习(RL)被认为是一种很有前途的方法,可以显着减少甩负荷量。然而,与大多数现有的基于机器学习(ML)的控制技术一样,RL控制通常不能保证被控系统的安全性。介绍了一种新的电力系统紧急切负荷的安全RL方法,该方法可以提高电网在发生故障后的电压安全恢复能力。与标准RL方法不同,安全RL方法具有由障碍函数组成的奖励函数,当系统状态达到安全界限时,该障碍函数达到负无穷大。因此,最优控制策略,使最大化的回报函数,可以使电力系统,以避免安全边界。该方法具有通用性,可应用于其它安全关键控制问题。在39节点IEEE基准上进行了数值仿真,以证明所提出的安全RL紧急控制的有效性,以及其对训练中未出现的故障的自适应能力。

英文摘要:

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of load which can be unnecessary and harmful to customers. Recently, deep reinforcement learning (RL) has been regarded and adopted as a promising approach that can significantly reduce the amount of load shedding. However, like most existing machine learning (ML)-based control techniques, RL control usually cannot guarantee the safety of the systems under control. In this paper, we introduce a novel safe RL method for emergency load shedding of power systems, that can enhance the safe voltage recovery of the electric power grid after experiencing faults. Unlike the standard RL method, the safe RL method has a reward function consisting of a Barrier function that goes to minus infinity when the system state goes to the safety bounds. Consequently, the optimal control policy, that maximizes the reward function, can render the power system to avoid the safety bounds. This method is general and can be applied to other safety-critical control problems. Numerical simulations on the 39-bus IEEE benchmark is performed to demonstrate the effectiveness of the proposed safe RL emergency control, as well as its adaptive capability to faults not seen in the training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑