The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms arise as a promising solution due to their data-driven and model-free features. However, current DRL algorithms fail to enforce rigorous operational constraints (e.g., power balance, ramping up or down constraints) limiting their implementation in real systems. To overcome this, in this paper, a DRL algorithm (namely MIP-DQN) is proposed, capable of \textit{strictly} enforcing all operational constraints in the action space, ensuring the feasibility of the defined schedule in real-time operation. This is done by leveraging recent optimization advances for deep neural networks (DNNs) that allow their representation as a MIP formulation, enabling further consideration of any action space constraints. Comprehensive numerical simulations show that the proposed algorithm outperforms existing state-of-the-art DRL algorithms, obtaining a lower error when compared with the optimal global solution (upper boundary) obtained after solving a mathematical programming formulation with perfect forecast information; while strictly enforcing all operational constraints (even in unseen test days).
Cooperative Energy Scheduling of Multi-Microgrids Based on Risk-Sensitive Reinforcement Learning
Guangxi University(广西大学);Tsinghua University(清华大学);The Hong Kong Polytechnic University(香港理工大学);Aalto University(阿尔托大学);Charleston Southern University(查尔斯顿南方大学)
A Joint Delay-Energy-Security Aware Framework for Intelligent Task Scheduling in Satellite-Terrestrial Edge Computing Network
Beijing Sport University(北京体育大学);Beijing University of Posts and Telecommunications(北京邮电大学);Nanjing University of Science and Technology(南京理工大学);Mendeleev University of Chemical Technology of Russia(门捷列夫俄罗斯化工技术大学)
Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach
Northeast Electric Power University(东北电力大学);Huazhong University of Science and Technology(华中科技大学);Cranfield University(克兰菲尔德大学)
Deep Reinforcement Learning-driven Cross-Community Energy Interaction Optimal Scheduling
Northeast Electric Power University(东北电力大学);State Grid Zibo Power Supply Company(国网淄博供电公司);State Grid Beijing Electric Power Company(国网北京市电力公司);State Grid Jining Power Supply Company(国网济宁供电公司)
Real-time scheduling of renewable power systems through planning-based reinforcement learning
Tsinghua University(清华大学);State Grid Corporation of China(国家电网有限公司);National Power Dispatching and Control Center(国家电力调度控制中心);China Electric Power Research Institute(中国电力科学研究院)
The Pump Scheduling Problem: A Real-World Scenario for Reinforcement Learning
Normandie Université(诺曼底大学);INSA Rouen(里昂大学鲁昂分校);LITIS Rouen(鲁昂LITIS研究所);Technical University of Kaiserslautern(凯撒斯劳滕技术大学);SAM Kaiserlaustern(凯撒斯劳滕SAM)