arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.20249cs.LG
收藏

用于建模时间相关物理现象的时序神经算子

Temporal Neural Operator for Modeling Time-Dependent Physical Phenomena

Khalifa University(卡利法大学);Delft University of Technology(代尔夫特理工大学)

W. Diab, M. Al-Kobaisi

AI总结:

本文提出时序神经算子(TNO),通过在DeepONet中引入时间分支并结合马尔可夫假设、教师强制等训练策略,解决了时间相关偏微分方程的时间动态映射问题,实现了长时间外推、误差鲁棒性和分辨率不变性。

摘要:

神经算子是一种机器学习模型,旨在通过学习函数空间之间的映射来求解偏微分方程(PDE)。诸如深度算子网络(DeepONet)和傅里叶神经算子(FNO)等神经算子在空间函数空间之间进行映射时展现出了出色的泛化特性。然而,它们在映射时间相关PDE的时间动态时存在困难,特别是对于训练期间未明确见过的时间步。这限制了它们的时间准确性,因为它们在训练过程中没有利用这些动态特性。此外,大多数神经算子的训练成本往往过高,特别是对于高维PDE。在本文中,我们提出了时序神经算子(TNO),这是一种专门为时间相关PDE的时空算子学习设计的高效神经算子。TNO通过在DeepONet框架中引入一个时间分支,借鉴了其他几种神经算子的最佳架构设计选择,并结合了包括马尔可夫假设、教师强制、时间打包以及根据当前状态或过去状态对输出进行条件化的灵活性等训练策略来实现这一点。通过对一组多样化的示例问题进行广泛的基准测试和消融研究,我们展示了TNO的长时间范围时间外推能力、对误差累积的鲁棒性、分辨率不变性以及处理多个输入函数的灵活性。

英文摘要:

Neural Operators (NOs) are machine learning models designed to solve partial differential equations (PDEs) by learning to map between function spaces. Neural Operators such as the Deep Operator Network (DeepONet) and the Fourier Neural Operator (FNO) have demonstrated excellent generalization properties when mapping between spatial function spaces. However, they struggle in mapping the temporal dynamics of time-dependent PDEs, especially for time steps not explicitly seen during training. This limits their temporal accuracy as they do not leverage these dynamics in the training process. In addition, most NOs tend to be prohibitively costly to train, especially for higher-dimensional PDEs. In this paper, we propose the Temporal Neural Operator (TNO), an efficient neural operator specifically designed for spatio-temporal operator learning for time-dependent PDEs. TNO achieves this by introducing a temporal-branch to the DeepONet framework, leveraging the best architectural design choices from several other NOs, and a combination of training strategies including Markov assumption, teacher forcing, temporal bundling, and the flexibility to condition the output on the current state or past states. Through extensive benchmarking and an ablation study on a diverse set of example problems we demonstrate the TNO long range temporal extrapolation capabilities, robustness to error accumulation, resolution invariance, and flexibility to handle multiple input functions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑