arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.01168cs.LGcs.AIcs.SYeess.SY
收藏

强化学习在电力系统关键应用中的研究进展与未来挑战

Reinforcement Learning for Selective Key Applications in Power Systems: Recent Advances and Future Challenges

Harvard University(哈佛大学);Carnegie Mellon University(卡内基梅隆大学);California Institute of Technology(加州理工学院)

Xin Chen, Guannan Qu, Yujie Tang, Steven Low, Na Li

摘要:

随着可再生能源发电和分布式能源的大规模集成,现代电力系统面临着新的运营挑战,如复杂性增加,不确定性增加,波动性加剧。与此同时,由于智能电表、智能传感器和升级的通信网络的广泛部署,越来越多的数据变得可用。因此,数据驱动控制技术,特别是强化学习(RL),近年来引起了人们的广泛关注。本文对各种强化学习技术以及它们如何应用于电力系统的决策和控制进行了全面的综述。特别是,我们选择了三个关键应用,即,频率调节、电压控制和能量管理,作为示例来说明基于RL的模型和解决方案。然后,我们提出了RL应用中的关键问题,即,安全性、鲁棒性、可扩展性和数据。还讨论了几个潜在的未来发展方向。

英文摘要:

With large-scale integration of renewable generation and distributed energy resources, modern power systems are confronted with new operational challenges, such as growing complexity, increasing uncertainty, and aggravating volatility. Meanwhile, more and more data are becoming available owing to the widespread deployment of smart meters, smart sensors, and upgraded communication networks. As a result, data-driven control techniques, especially reinforcement learning (RL), have attracted surging attention in recent years. This paper provides a comprehensive review of various RL techniques and how they can be applied to decision-making and control in power systems. In particular, we select three key applications, i.e., frequency regulation, voltage control, and energy management, as examples to illustrate RL-based models and solutions. We then present the critical issues in the application of RL, i.e., safety, robustness, scalability, and data. Several potential future directions are discussed as well.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑