LordNet:一种无需模拟数据即可学习求解参数化偏微分方程的高效神经网络
LordNet: An Efficient Neural Network for Learning to Solve Parametric Partial Differential Equations without Simulated Data
AI总结:
本文针对无模拟数据的参数化PDE求解问题,提出利用MSR损失学习物理约束,并设计低秩矩阵乘法建模长程纠缠的LordNet,在精度、泛化、速度和参数规模上优于现有网络。
摘要:
神经算子作为无限维函数空间之间非线性算子的一种强大近似,已被证明在加速偏微分方程(PDE)求解方面颇具前景。然而,它需要大量模拟数据,而这些数据的收集成本可能很高。通过从物理约束损失中学习物理规律,可以避免这一问题;我们将这种由离散化PDE构造的损失称为均方残差(MSR)损失。我们研究了MSR损失中的物理信息,并将其称为长程纠缠,同时识别出一项挑战:神经网络需要具备在PDE空间域中建模长程纠缠的能力,而这些纠缠的模式在不同PDE中会发生变化。为应对该挑战,我们提出了LordNet,这是一种可调且高效的神经网络,用于建模各种纠缠。受传统求解器启发,LordNet通过一系列矩阵乘法建模长程纠缠,这些矩阵乘法可被视为对一般全连接层的低秩近似,并以更低的计算成本提取主导模式。在求解Poisson方程以及(二维和三维)Navier-Stokes方程上的实验表明,LordNet能够很好地建模来自MSR损失的长程纠缠,从而获得优于其他神经网络的准确性和泛化能力。结果显示,LordNet可比传统PDE求解器快40倍。此外,LordNet以最小的参数量在准确性和效率方面优于其他现代神经网络架构。
英文摘要:
Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a large amount of simulated data, which can be costly to collect. This can be avoided by learning physics from the physics-constrained loss, which we refer to it as mean squared residual (MSR) loss constructed by the discretized PDE. We investigate the physical information in the MSR loss, which we called long-range entanglements, and identify the challenge that the neural network requires the capacity to model the long-range entanglements in the spatial domain of the PDE, whose patterns vary in different PDEs. To tackle the challenge, we propose LordNet, a tunable and efficient neural network for modeling various entanglements. Inspired by the traditional solvers, LordNet models the long-range entanglements with a series of matrix multiplications, which can be seen as the low-rank approximation to the general fully-connected layers and extracts the dominant pattern with reduced computational cost. The experiments on solving Poisson's equation and (2D and 3D) Navier-Stokes equation demonstrate that the long-range entanglements from the MSR loss can be well modeled by the LordNet, yielding better accuracy and generalization ability than other neural networks. The results show that the Lordnet can be $40\times$ faster than traditional PDE solvers. In addition, LordNet outperforms other modern neural network architectures in accuracy and efficiency with the smallest parameter size.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。