arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.04824eess.SYcs.SY
收藏

强化学习与混合规划在低碳系统电厂调度中的比较与融合

Reinforcement Learning and Mixed-Integer Programming for Power Plant Scheduling in Low Carbon Systems: Comparison and Hybridisation

Cormac O'Malley, Patrick de Mars, Luis Badesa, Goran Strbac

摘要:

脱碳正在推动可再生能源发电的大幅增长。这增加了由发电厂服务的负载的不确定性,并且使得它们的有效调度(称为机组组合(UC)问题)更加困难。UC在实践中是通过混合整数规划(MIP)方法解决的;然而,人们对包括强化学习(RL)在内的新兴数据驱动方法的兴趣越来越大。在本文中,我们广泛测试两个MIP(确定性和随机性)和两个RL(无模型和前瞻性)调度方法在一个大的测试日和问题大小,第一次比较这两种方法的最先进的水平竞争环境。我们发现,确定性和随机MIP始终产生成本较低的UC调度比RL,表现出更好的可靠性和可扩展性的问题大小。对于50个发电机的测试用例,RL的平均运行成本是随机MIP的2倍以上,而在最坏的情况下,成本是13倍。然而,RL的关键优势是能够几乎立即产生解决方案,而不管问题的大小。我们利用这一优势,产生各种初始解决方案的热启动并发随机MIP解决方案。通过同时产生几个接近最优的解决方案,然后使用Monte Carlo方法评估它们,利用真正的代价函数和离散近似之间的差异,制定MIP。由此产生的混合技术优于RL和MIP方法,平均降低总运营成本0.3%。

英文摘要:

Decarbonisation is driving dramatic growth in renewable power generation. This increases uncertainty in the load to be served by power plants and makes their efficient scheduling, known as the unit commitment (UC) problem, more difficult. UC is solved in practice by mixed-integer programming (MIP) methods; however, there is growing interest in emerging data-driven methods including reinforcement learning (RL). In this paper, we extensively test two MIP (deterministic and stochastic) and two RL (model-free and with lookahead) scheduling methods over a large set of test days and problem sizes, for the first time comparing the state-of-the-art of these two approaches on a level playing field. We find that deterministic and stochastic MIP consistently produce lower-cost UC schedules than RL, exhibiting better reliability and scalability with problem size. Average operating costs of RL are more than 2 times larger than stochastic MIP for a 50-generator test case, while the cost is 13 times larger in the worst instance. However, the key strength of RL is the ability to produce solutions practically instantly, irrespective of problem size. We leverage this advantage to produce various initial solutions for warm starting concurrent stochastic MIP solves. By producing several near-optimal solutions simultaneously and then evaluating them using Monte Carlo methods, the differences between the true cost function and the discrete approximation required to formulate the MIP are exploited. The resulting hybrid technique outperforms both the RL and MIP methods individually, reducing total operating costs by 0.3% on average.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑