arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.08430cs.LGcs.SYeess.SY
收藏

基于集中式和分散式强化学习Agent的多阶段输电线路潮流控制

Multi-Stage Transmission Line Flow Control Using Centralized and Decentralized Reinforcement Learning Agents

GEIRI North America(全球能源互联网研究院北美分院);Jinhua Electric Power Company(金华电力公司);SGCC Zhejiang Electric Power Company(国网浙江省电力公司)

Xiumin Shang, Jinping Yang, Bingquan Zhu, Lin Ye, Jing Zhang, Jianping Xu, Qin Lyu, Ruisheng Diao

摘要:

规划满足安全和经济约束的大容量电力系统的未来操作场景通常需要在执行大规模仿真时进行密集的劳动力努力。为了自动化这一过程,减轻工程师的负担,本文提出了一种新的多阶段控制方法,训练集中式和分散式强化学习代理,可以自动调整电网控制器调节输电线路流量在正常条件下和在突发事件。将电网潮流控制问题转化为马尔可夫决策过程(MDP)。在第一阶段,集中式软行动者-评论家(SAC)代理被训练来控制发电机有功功率输出在一个广泛的区域,以控制输电线路流量对指定的安全限制。如果线路过载问题仍未解决,则使用阶段二通过本地变电站处的负载切换来训练分散的SAC代理。以浙江省电力公司电网运行规划为例,验证了该方法的有效性。

英文摘要:

Planning future operational scenarios of bulk power systems that meet security and economic constraints typically requires intensive labor efforts in performing massive simulations. To automate this process and relieve engineers' burden, a novel multi-stage control approach is presented in this paper to train centralized and decentralized reinforcement learning agents that can automatically adjust grid controllers for regulating transmission line flows at normal condition and under contingencies. The power grid flow control problem is formulated as Markov Decision Process (MDP). At stage one, centralized soft actor-critic (SAC) agent is trained to control generator active power outputs in a wide area to control transmission line flows against specified security limits. If line overloading issues remain unresolved, stage two is used to train decentralized SAC agent via load throw-over at local substations. The effectiveness of the proposed approach is verified on a series of actual planning cases used for operating the power grid of SGCC Zhejiang Electric Power Company.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑