基于RLlib-IMPALA框架的可扩展Volt-VAR优化：一种强化学习方法
Scalable Volt-VAR Optimization using RLlib-IMPALA Framework: A Reinforcement Learning Approach
AI总结：
本文提出基于RLlib-IMPALA框架的深度强化学习方法，利用RAY分布式计算能力解决电力系统Volt-VAR优化问题，在奖励结果和计算效率上均显著优于现有DRL方法，训练速度提升超10倍。
摘要：
在快速发展的电力系统领域，Volt-VAR优化（VVO）日益关键，尤其是随着可再生能源的蓬勃整合。传统基于学习的VVO方法在广阔且动态变化的电力系统中常常受到计算复杂性的阻碍。为应对这一挑战，我们的研究提出了一种新颖的框架，该框架利用深度强化学习（DRL）的潜力，具体采用重要性加权Actor-Learner架构（IMPALA）算法，并在RAY平台上执行。该框架构建于RLlib——强化学习领域的行业标准——之上，巧妙地利用了RAY提供的分布式计算能力和高级超参数调优。这一设计显著加速了VVO解空间中的探索与利用阶段。我们的实证结果表明，该方法不仅在获得更优奖励结果方面超越了现有DRL方法，而且表现出计算需求显著降低十倍的效果。我们的DRL智能体与RAY平台的集成促成了RLlib-IMPALA的创建，这是一个新颖的框架，能够高效利用RAY的资源来提升系统适应性与控制能力。RLlib-IMPALA借助RAY的工具包增强了分析能力，并显著加快了训练速度，使其比其他最先进的DRL方法快10倍以上。
英文摘要：
In the rapidly evolving domain of electrical power systems, the Volt-VAR optimization (VVO) is increasingly critical, especially with the burgeoning integration of renewable energy sources. Traditional approaches to learning-based VVO in expansive and dynamically changing power systems are often hindered by computational complexities. To address this challenge, our research presents a novel framework that harnesses the potential of Deep Reinforcement Learning (DRL), specifically utilizing the Importance Weighted Actor-Learner Architecture (IMPALA) algorithm, executed on the RAY platform. This framework, built upon RLlib-an industry-standard in Reinforcement Learning-ingeniously capitalizes on the distributed computing capabilities and advanced hyperparameter tuning offered by RAY. This design significantly expedites the exploration and exploitation phases in the VVO solution space. Our empirical results demonstrate that our approach not only surpasses existing DRL methods in achieving superior reward outcomes but also manifests a remarkable tenfold reduction in computational requirements. The integration of our DRL agent with the RAY platform facilitates the creation of RLlib-IMPALA, a novel framework that efficiently uses RAY's resources to improve system adaptability and control. RLlib-IMPALA leverages RAY's toolkit to enhance analytical capabilities and significantly speeds up training to become more than 10 times faster than other state-of-the-art DRL methods.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
