CommonPower:一种用于安全数据驱动智能电网控制的框架
CommonPower: A Framework for Safe Data-Driven Smart Grid Control
AI总结:
针对电力系统管理中强化学习案例设计复杂及约束保障缺失问题,提出通用框架CommonPower,支持模块化建模、自动综合控制器与保障,并集成预测器训练及保障反馈学习机制。
摘要:
电力系统管理日益复杂,导致人们对强化学习(RL)的兴趣增加。为了验证其有效性,强化学习算法必须在多个案例研究中评估。案例研究设计是一项艰巨的任务,需要考虑许多方面,其中包括可用预测的影响以及控制结构中分散化的程度。此外,普通强化学习控制器本身无法确保满足系统约束,这使得在每个案例研究部署系统之前设计一个保障机制成为一项必要任务。为了解决这些不足,我们引入了Python工具CommonPower,这是第一个面向机器学习的电力系统管理建模与仿真的通用框架。其模块化架构使用户能够专注于特定元素,而无需实现仿真环境。CommonPower的另一个独特贡献是自动综合模型预测控制器和保障机制。除了为单智能体强化学习、多智能体强化学习和最优控制提供统一接口外,CommonPower还包括一个基于机器学习的预测器训练流程,以及一个将保障反馈纳入强化学习控制器学习更新的灵活机制。
英文摘要:
The growing complexity of power system management has led to an increased interest in reinforcement learning (RL). To validate their effectiveness, RL algorithms have to be evaluated across multiple case studies. Case study design is an arduous task requiring the consideration of many aspects, among them the influence of available forecasts and the level of decentralization in the control structure. Furthermore, vanilla RL controllers cannot themselves ensure the satisfaction of system constraints, which makes devising a safeguarding mechanism a necessary task for every case study before deploying the system. To address these shortcomings, we introduce the Python tool CommonPower, the first general framework for the modeling and simulation of power system management tailored towards machine learning. Its modular architecture enables users to focus on specific elements without having to implement a simulation environment. Another unique contribution of CommonPower is the automatic synthesis of model predictive controllers and safeguards. Beyond offering a unified interface for single-agent RL, multi-agent RL, and optimal control, CommonPower includes a training pipeline for machine-learning-based forecasters as well as a flexible mechanism for incorporating feedback of safeguards into the learning updates of RL controllers.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。