arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1905.11079cs.LGcs.NAmath.NAphysics.comp-ph
收藏

学习离散化:通过深度强化学习求解一维标量守恒律

Learning to Discretize: Solving 1D Scalar Conservation Laws via Deep Reinforcement Learning

Carnegie Mellon University(卡内基梅隆大学);Peking University(北京大学)

Yufei Wang, Ziju Shen, Zichao Long, Bin Dong

摘要:

守恒定律被认为是自然界的基本定律。它在物理学、化学、生物学、地质学和工程学等许多领域有着广泛的应用。求解与守恒律有关的微分方程是计算数学的一个重要分支。最近机器学习的成功,特别是深度学习在计算机视觉和自然语言处理等领域的成功,吸引了计算数学界的大量关注,并激发了许多将机器学习与传统方法相结合的有趣工作。在本文中,我们首次将数值PDE求解器视为MDP,并使用(深度)RL来学习新的求解器。作为概念的证明,我们专注于一维标量守恒律。我们部署了深度强化学习的机制来训练一个策略网络,该网络可以决定如何以顺序和时空自适应的方式近似数值解。我们将证明,求解守恒律的问题可以自然地被视为一个顺序决策过程,以这种方式学习的数值方案可以很容易地实现长期精度。此外,学习的策略网络经过精心设计,以根据解决方案的当前状态确定一个良好的局部离散近似,这基本上使所提出的方法成为一种元学习方法。换句话说,所提出的方法能够学习如何模仿人类专家在给定情况下进行离散化。最后,我们将详细介绍策略网络是如何训练的,与一些最先进的数值求解器(如WENO方案)和基于监督学习的方法L3D和PINN相比,它的表现如何,以及它的泛化能力如何。

英文摘要:

Conservation laws are considered to be fundamental laws of nature. It has broad applications in many fields, including physics, chemistry, biology, geology, and engineering. Solving the differential equations associated with conservation laws is a major branch in computational mathematics. The recent success of machine learning, especially deep learning in areas such as computer vision and natural language processing, has attracted a lot of attention from the community of computational mathematics and inspired many intriguing works in combining machine learning with traditional methods. In this paper, we are the first to view numerical PDE solvers as an MDP and to use (deep) RL to learn new solvers. As proof of concept, we focus on 1-dimensional scalar conservation laws. We deploy the machinery of deep reinforcement learning to train a policy network that can decide on how the numerical solutions should be approximated in a sequential and spatial-temporal adaptive manner. We will show that the problem of solving conservation laws can be naturally viewed as a sequential decision-making process, and the numerical schemes learned in such a way can easily enforce long-term accuracy. Furthermore, the learned policy network is carefully designed to determine a good local discrete approximation based on the current state of the solution, which essentially makes the proposed method a meta-learning approach. In other words, the proposed method is capable of learning how to discretize for a given situation mimicking human experts. Finally, we will provide details on how the policy network is trained, how well it performs compared with some state-of-the-art numerical solvers such as WENO schemes, and supervised learning based approach L3D and PINN, and how well it generalizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑