arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.04817physics.acc-phcs.NE
收藏

利用基于梯度的仿真能力实现粒子加速器中的多目标优化

Harnessing the Power of Gradient-Based Simulations for Multi-Objective Optimization in Particle Accelerators

Kishansingh Rajput, Malachi Schram, Auralee Edelen, Jonathan Colen, Armen Kasparian, Ryan Roussel, Adam Carpenter, He Zhang, Jay Benesch

AI总结:

本文提出深度可微分强化学习算法,在粒子加速器中同时优化热负荷与停机率,利用可微分代理模型反向传播梯度,并在高维问题上优于无模型强化学习、遗传算法和贝叶斯优化。

摘要:

粒子加速器的运行需要同时优化多个目标。由于各目标之间存在权衡,多目标优化(MOO)尤为具有挑战性。进化算法(如遗传算法(GA))已被用于许多优化问题,然而,它们从设计上并不适用于复杂的控制问题。本文展示了可微分性在解决粒子加速器中多目标优化问题方面的强大能力,采用了一种深度可微分强化学习(DDRL)算法。我们将DDRL算法与无模型强化学习(MFRL)、GA和贝叶斯优化(BO)进行比较,以在连续电子束加速器设施(CEBAF)中同时优化热负荷和停机率。该问题对单个状态和动作以及束流能量的累积(全局)约束都施加了严格限制。我们开发了一个基于真实数据的物理代理模型。该代理模型是可微分的,允许梯度的反向传播。结果以两个目标的帕累托前沿形式进行评估。我们表明,在高维问题上,DDRL优于MFRL、BO和GA。

英文摘要:

Particle accelerator operation requires simultaneous optimization of multiple objectives. Multi-Objective Optimization (MOO) is particularly challenging due to trade-offs between the objectives. Evolutionary algorithms, such as genetic algorithm (GA), have been leveraged for many optimization problems, however, they do not apply to complex control problems by design. This paper demonstrates the power of differentiability for solving MOO problems using a Deep Differentiable Reinforcement Learning (DDRL) algorithm in particle accelerators. We compare DDRL algorithm with Model Free Reinforcement Learning (MFRL), GA and Bayesian Optimization (BO) for simultaneous optimization of heat load and trip rates in the Continuous Electron Beam Accelerator Facility (CEBAF). The underlying problem enforces strict constraints on both individual states and actions as well as cumulative (global) constraint for energy requirements of the beam. A physics-based surrogate model based on real data is developed. This surrogate model is differentiable and allows back-propagation of gradients. The results are evaluated in the form of a Pareto-front for two objectives. We show that the DDRL outperforms MFRL, BO, and GA on high dimensional problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑