arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.05412eess.SYcs.SY
收藏

多网络约束综合社区能源系统的技术经济建模与安全运行优化

Techno-Economic Modeling and Safe Operational Optimization of Multi-Network Constrained Integrated Community Energy Systems

Ze Hu, Ka Wing Chan, Ziqing Zhu, Xiang Wei, Weiye Zheng, Siqi Bu

AI总结:

针对电、气、热多网络约束下ICES运行优化难题,本文构建含IDR与网络约束的C-MDP模型,并提出PD-TD3安全强化学习算法,在隐私保护和部分信息下兼顾利润提升与约束违例减少。

摘要:

综合社区能源系统(ICES)已成为通过有效协调多种能源来提高配电系统效率的一种有前景的解决方案。然而,ICES的运行优化受到包括电力、天然气和热力在内的异构网络物理约束的阻碍。由于网络约束的非线性以及多网络协调的高度复杂性,这些挑战难以应对。因此,本文提出一种新颖的安全强化学习(SRL)算法,以优化ICES的多网络约束运行问题。首先,建立一个考虑综合需求响应(IDR)、多种能源设备和网络约束的综合ICES模型。随后,提出ICES的多网络运行优化问题,并将其重新表述为考虑违反物理网络约束的约束马尔可夫决策过程(C-MDP)。所提出的名为Primal-Dual Twin Delayed Deep Deterministic Policy Gradient(PD-TD3)的新型SRL算法通过采用拉格朗日乘子惩罚多网络约束违例来求解C-MDP,确保违例处于可容忍范围内,同时避免低奖励的过度保守策略。该算法准确估计训练过程的累积奖励和成本,从而在仅有部分信息的隐私保护环境中,在提高利润和减少约束违例之间实现公平平衡。一项将所提算法与基准RL算法进行比较的案例研究证明了其在增加总利润和缓解网络约束违例方面的计算性能。

英文摘要:

The integrated community energy system (ICES) has emerged as a promising solution for enhancing the efficiency of the distribution system by effectively coordinating multiple energy sources. However, the operational optimization of ICES is hindered by the physical constraints of heterogeneous networks including electricity, natural gas, and heat. These challenges are difficult to address due to the non-linearity of network constraints and the high complexity of multi-network coordination. This paper, therefore, proposes a novel Safe Reinforcement Learning (SRL) algorithm to optimize the multi-network constrained operation problem of ICES. Firstly, a comprehensive ICES model is established considering integrated demand response (IDR), multiple energy devices, and network constraints. The multi-network operational optimization problem of ICES is then presented and reformulated as a constrained Markov Decision Process (C-MDP) accounting for violating physical network constraints. The proposed novel SRL algorithm, named Primal-Dual Twin Delayed Deep Deterministic Policy Gradient (PD-TD3), solves the C-MDP by employing a Lagrangian multiplier to penalize the multi-network constraint violation, ensuring that violations are within a tolerated range and avoid over-conservative strategy with a low reward at the same time. The proposed algorithm accurately estimates the cumulative reward and cost of the training process, thus achieving a fair balance between improving profits and reducing constraint violations in a privacy-protected environment with only partial information. A case study comparing the proposed algorithm with benchmark RL algorithms demonstrates the computational performance in increasing total profits and alleviating the network constraint violations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑