arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.16256eess.SYcs.SY
收藏

智能电网应用中安全强化学习技术的批判性综述

A Critical Review of Safe Reinforcement Learning Techniques in Smart Grid Applications

Van-Hai Bui, Srijita Das, Akhtar Hussain, Guilherme Vieira Hollweg, Wencong Su

AI总结:

本文综述了安全强化学习(safe RL)在智能电网中的应用,涵盖从分布式能源高渗透带来的不确定性背景、各类safe RL算法在多种电力场景下的应用,并分析了现有方法的瓶颈、挑战与机遇,以支持带安全约束的电网运行研究。

摘要:

现代智能电力系统中分布式能源(DERs)的高渗透率给电力部门带来了不可预见的 uncertainties,导致电力系统运行和控制的复杂性与难度增加。作为前沿的机器学习技术,深度强化学习(DRL)近年来被广泛用于处理电力系统中的不确定性。然而,在电力系统等关键基础设施中,安全问题始终享有最高优先级,而 DRL 可能并不总能满足电力系统运营商的安全要求。安全强化学习(safe RL)的概念正作为一种潜在解决方案出现,以克服传统 DRL 在电力系统运行和控制中的缺陷。本研究对聚焦于 safe RL 的最新研究工作进行了严格审查,这些工作旨在推导电力系统控制策略,同时兼顾电网独特的安全要求。此外,本研究重点介绍了应用于电力系统领域多种场景的各类 safe RL 算法,场景涵盖从单个并网电力转换器、住宅智能家居和建筑,到大型配电网络。对于所列出的所有方法,本文还讨论了它们在电力系统应用运行和控制中的瓶颈、研究挑战与潜在机遇。本综述旨在支持 safe RL 算法领域的研究,使其能够在 DERs 带来的高不确定性下,实现带有安全约束的智能电力系统运行。

英文摘要:

The high penetration of distributed energy resources (DERs) in modern smart power systems introduces unforeseen uncertainties for the electricity sector, leading to increased complexity and difficulty in the operation and control of power systems. As a cutting-edge machine learning technology, deep reinforcement learning (DRL) has been widely implemented in recent years to handle the uncertainty in power systems. However, in critical infrastructures such as power systems, safety issues always receive top priority, while DRL may not always meet the safety requirements of power system operators. The concept of safe reinforcement learning (safe RL) is emerging as a potential solution to overcome the shortcomings of conventional DRL in the operation and control of power systems. This study provides a rigorous review of the latest research efforts focused on safe RL to derive power system control policies while accounting for the unique safety requirements of power grids. Furthermore, this study highlights various safe RL algorithms applied in diverse applications within the power system sector, from single grid-connected power converters, residential smart homes, and buildings to large power distribution networks. For all methods outlined, a discussion on their bottlenecks, research challenges, and potential opportunities in the operation and control of power system applications is also presented. This review aims to support research in the area of safe RL algorithms, embracing smart power system operation with safety constraints amid high uncertainty from DERs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑