arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.17402physics.comp-phcs.LGcs.SYeess.SY
收藏

Beacon:一个面向流动控制的轻量级深度强化学习基准库

Beacon, a lightweight deep reinforcement learning benchmark library for flow control

MINES Paristech(巴黎高等矿业学院);CEMEF;PSL - Research University(巴黎文理研究大学)

Jonathan Viquerat, Philippe Meliga, Pablo Jeken, Elie Hachem

AI总结:

针对深度强化学习流动控制领域缺乏通用基准、结果难复现的问题,研究人员提出开源轻量级基准库Beacon,包含7个不同特性的1D/2D流动控制问题并提供参考方案,助力领域标准化发展。

摘要:

近年来,深度强化学习在流动控制问题中的应用日益广泛,催生了一个新的研究领域,其核心是将现有算法与数值流体动力学环境的控制进行耦合与适配。尽管该领域仍处于起步阶段,但已在短时间内取得了多项成功,其快速发展在一定程度上得益于推动社区扩张的开源努力。然而,这一新兴领域仍缺乏一个通用平台,用于(i)确保结果的可复现性,以及(ii)提供合适的专用基准测试基础。为此,我们提出了Beacon,这是一个开源基准库,包含7个轻量级的一维与二维流动控制问题,这些问题具有不同的特性、动作与观测空间特征以及CPU需求。本文介绍了所涉及的7个问题,并提供了参考控制方案。相关工作的源码可在https://github.com/jviquerat/beacon获取。

英文摘要:

Recently, the increasing use of deep reinforcement learning for flow control problems has led to a new area of research, focused on the coupling and the adaptation of the existing algorithms to the control of numerical fluid dynamics environments. Although still in its infancy, the field has seen multiple successes in a short time span, and its fast development pace can certainly be partly imparted to the open-source effort that drives the expansion of the community. Yet, this emerging domain still misses a common ground to (i) ensure the reproducibility of the results, and (ii) offer a proper ad-hoc benchmarking basis. To this end, we propose Beacon, an open-source benchmark library composed of seven lightweight 1D and 2D flow control problems with various characteristics, action and observation space characteristics, and CPU requirements. In this contribution, the seven considered problems are described, and reference control solutions are provided. The sources for the following work are available at https://github.com/jviquerat/beacon.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑