arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.18531cs.LGcs.AIcs.DC
收藏

基于深度强化学习的智能电网系统能耗优化

Deep Reinforcement Learning for Optimizing Energy Consumption in Smart Grid Systems

Iran university of Science and Technology(伊朗科技大学);Islamic Azad university(伊斯兰阿扎德大学)

Abeer Alsheikhi, Amirfarhad Farhadi, Azadeh Zamanifar

AI总结:

本文提出利用物理信息神经网络改进强化学习,以提高智能电网能耗优化的效率和性能。

摘要:

在智能电网背景下,能源管理问题本质上复杂,因为系统组件之间存在相互依赖关系。尽管强化学习(RL)已被提出用于解决最优功率流(OPF)问题,但对环境的迭代交互需求通常需要计算成本高昂的模拟器,导致显著的样本效率低下。在本研究中,通过使用物理信息神经网络(PINNs)来解决这些挑战,可以替代传统且昂贵的智能电网模拟器。增强的RL策略学习过程使得收敛时间可以缩短到原始环境所需时间的十分之一。PINN基于的替代模型与其它基准数据驱动替代模型进行比较。通过结合底层物理定律的知识,结果表明,PINN替代模型是唯一在本情境中能够获得强RL策略的方法,即使没有访问真实模拟器的样本。结果表明,使用PINN替代模型相比没有替代模型的RL训练可以加速50%。这种方法使能够快速生成与原始模拟器产生的性能评分相似的评分。

英文摘要:

The energy management problem in the context of smart grids is inherently complex due to the interdependencies among diverse system components. Although Reinforcement Learning (RL) has been proposed for solving Optimal Power Flow (OPF) problems, the requirement for iterative interaction with an environment often necessitates computationally expensive simulators, leading to significant sample inefficiency. In this study, these challenges are addressed through the use of Physics-Informed Neural Networks (PINNs), which can replace conventional and costly smart grid simulators. The RL policy learning process is enhanced so that convergence can be achieved in a fraction of the time required by the original environment. The PINN-based surrogate is compared with other benchmark data-driven surrogate models. By incorporating knowledge of the underlying physical laws, the results show that the PINN surrogate is the only approach considered in this context that can obtain a strong RL policy even without access to samples from the true simulator. The results demonstrate that using PINN surrogates can accelerate training by 50% compared to RL training without a surrogate. This approach enables the rapid generation of performance scores similar to those produced by the original simulator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑