arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.10909cs.LGstat.ML
收藏

用于算子学习的变量误差模型

Error-in-variables modelling for operator learning

Sandia National Laboratories(桑迪亚国家实验室);University of Alabama(阿拉巴马大学)

Ravi G. Patel, Indu Manickam, Myoungkyu Lee, Mamikon Gulian

摘要:

深度算子学习已经成为降阶建模和PDE模型发现的一种有前途的工具。利用深度神经网络的表达能力,特别是在高维中,这样的方法学习功能状态变量之间的映射。虽然所提出的方法假设噪声仅在因变量中,但用于操作者学习的实验和数值数据通常也在自变量中表现出噪声,因为这两个变量都表示受测量误差影响的信号。在对标量数据的回归中,未能考虑有噪的独立变量可能会导致参数估计有偏差。对于有噪声的自变量,通过普通最小二乘(OLS)拟合的线性模型将显示衰减偏差,其中斜率将被低估。在这项工作中,我们推导出一个模拟的衰减偏差的线性算子回归白噪声的独立和因变量。在非线性设置中,我们计算证明了在自变量中存在噪声的情况下,Burgers算子的作用的预测不足。我们提出了两种算子回归方法MOR-Physics和DeepONet的变量误差(EiV)模型,并证明了这些新模型在各种算子学习问题中存在噪声自变量的情况下减少了偏差。考虑到1D和2D中的Burgers算子,我们证明了EiV算子学习在击败OLS算子学习的高噪声区域中鲁棒地恢复算子。我们还介绍了一个EiV模型的时间演化PDE发现,并表明OLS和EiV执行类似的学习Kuramoto-Sivashinsky演化算子从损坏的数据,这表明OLS算子学习中的偏差的影响取决于目标算子的规律性。

英文摘要:

Deep operator learning has emerged as a promising tool for reduced-order modelling and PDE model discovery. Leveraging the expressive power of deep neural networks, especially in high dimensions, such methods learn the mapping between functional state variables. While proposed methods have assumed noise only in the dependent variables, experimental and numerical data for operator learning typically exhibit noise in the independent variables as well, since both variables represent signals that are subject to measurement error. In regression on scalar data, failure to account for noisy independent variables can lead to biased parameter estimates. With noisy independent variables, linear models fitted via ordinary least squares (OLS) will show attenuation bias, wherein the slope will be underestimated. In this work, we derive an analogue of attenuation bias for linear operator regression with white noise in both the independent and dependent variables. In the nonlinear setting, we computationally demonstrate underprediction of the action of the Burgers operator in the presence of noise in the independent variable. We propose error-in-variables (EiV) models for two operator regression methods, MOR-Physics and DeepONet, and demonstrate that these new models reduce bias in the presence of noisy independent variables for a variety of operator learning problems. Considering the Burgers operator in 1D and 2D, we demonstrate that EiV operator learning robustly recovers operators in high-noise regimes that defeat OLS operator learning. We also introduce an EiV model for time-evolving PDE discovery and show that OLS and EiV perform similarly in learning the Kuramoto-Sivashinsky evolution operator from corrupted data, suggesting that the effect of bias in OLS operator learning depends on the regularity of the target operator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑