arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.09023physics.comp-phcs.LG
收藏

基于多Agent强化学习的Turbulence自动建模

Automating Turbulence Modeling by Multi-Agent Reinforcement Learning

ETH Zürich(苏黎世联邦理工学院)

Guido Novati, Hugues Lascombes de Laroussilhe, Petros Koumoutsakos

摘要:

湍流的建模对于从飞机设计到天气预报和气候预测的科学和工程问题至关重要。在过去的60年里,人们提出了许多湍流模型,主要是基于物理见解和工程直觉。机器学习和数据科学的最新进展激发了新的努力来补充这些方法。到目前为止,所有这些努力都集中在监督学习上,尽管已经证明有希望,但在训练数据分布之外的推广方面遇到了困难。在这项工作中,我们引入多智能体强化学习(MARL)作为湍流模型的自动发现工具。我们证明了这种方法的潜力大涡模拟的均匀和各向同性湍流作为奖励的直接数值模拟的统计特性的恢复。在这里,制定的封闭模型作为一个控制策略制定的合作代理,检测流场中的关键时空模式,以估计未解决的亚网格尺度(SGS)物理。目前的结果是获得国家的最先进的算法的基础上的经验重放和比较有利的动态SGS建模方法。此外,我们表明,目前的湍流模型概括跨网格大小和流动条件所表示的雷诺数。

英文摘要:

The modeling of turbulent flows is critical to scientific and engineering problems ranging from aircraft design to weather forecasting and climate prediction. Over the last sixty years numerous turbulence models have been proposed, largely based on physical insight and engineering intuition. Recent advances in machine learning and data science have incited new efforts to complement these approaches. To date, all such efforts have focused on supervised learning which, despite demonstrated promise, encounters difficulties in generalizing beyond the distributions of the training data. In this work we introduce multi-agent reinforcement learning (MARL) as an automated discovery tool of turbulence models. We demonstrate the potential of this approach on Large Eddy Simulations of homogeneous and isotropic turbulence using as reward the recovery of the statistical properties of Direct Numerical Simulations. Here, the closure model is formulated as a control policy enacted by cooperating agents, which detect critical spatio-temporal patterns in the flow field to estimate the unresolved sub-grid scale (SGS) physics. The present results are obtained with state-of-the-art algorithms based on experience replay and compare favorably with established dynamic SGS modeling approaches. Moreover, we show that the present turbulence models generalize across grid sizes and flow conditions as expressed by the Reynolds numbers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑