Deep operator learning has emerged as a promising tool for reduced-order modelling and PDE model discovery. Leveraging the expressive power of deep neural networks, especially in high dimensions, such methods learn the mapping between functional state variables. While proposed methods have assumed noise only in the dependent variables, experimental and numerical data for operator learning typically exhibit noise in the independent variables as well, since both variables represent signals that are subject to measurement error. In regression on scalar data, failure to account for noisy independent variables can lead to biased parameter estimates. With noisy independent variables, linear models fitted via ordinary least squares (OLS) will show attenuation bias, wherein the slope will be underestimated. In this work, we derive an analogue of attenuation bias for linear operator regression with white noise in both the independent and dependent variables. In the nonlinear setting, we computationally demonstrate underprediction of the action of the Burgers operator in the presence of noise in the independent variable. We propose error-in-variables (EiV) models for two operator regression methods, MOR-Physics and DeepONet, and demonstrate that these new models reduce bias in the presence of noisy independent variables for a variety of operator learning problems. Considering the Burgers operator in 1D and 2D, we demonstrate that EiV operator learning robustly recovers operators in high-noise regimes that defeat OLS operator learning. We also introduce an EiV model for time-evolving PDE discovery and show that OLS and EiV perform similarly in learning the Kuramoto-Sivashinsky evolution operator from corrupted data, suggesting that the effect of bias in OLS operator learning depends on the regularity of the target operator.
Latent Variable Modelling with Hyperbolic Normalizing Flows
McGill University(麦吉尔大学);Mila(米拉研究所);University of Toronto(多伦多大学);Vector Institute(向量研究所)
近似后验分布的选择在随机变分推理(SVI)中起着核心作用。一个有效的解决方案是使用归一化流\cut{defined on Euclidean spaces}来构造灵活的后验分布。然而,现有的规范化流的一个关键限制是,它们被限制在欧几里德空间,并且不适合对具有底层层次结构的数据进行建模。为了解决这个基本的限制,我们提出了规范化流的双曲空间的第一个扩展。我们首先提升规范化流双曲空间使用耦合变换定义的切丛,称为切线耦合($\mathcal{TC}$)。我们进一步介绍了包裹双曲面耦合($\mathcal{W}\mathbb{H}C$),一个完全可逆的和可学习的变换,明确利用双曲空间的几何结构,允许表达后验,同时是有效的采样。我们证明了我们的新的归一化流的双曲VAE和欧几里得归一化流的功效。我们的方法提高了密度估计的性能,以及表现出分层结构的真实世界图数据的重建。最后,我们表明,我们的方法可以用来权力的生成模型在分层数据使用双曲型潜变量。
Mutual information for the selection of relevant variables in spectrometric nonlinear modelling
INRIA-Rocquencourt(法国国家信息与自动化研究所罗夸恩库尔特中心);Helsinki University of Technology(赫尔辛基理工大学);Université catholique de Louvain(天主教鲁汶大学);Université Paris I Panthéon Sorbonne(巴黎第一大学先贤祠-索邦大学)
Physics-informed neural operator for parametric phase-field modelling of interfacial degradation and microstructural evolution
Tongji University, College of Civil Engineering(同济大学,土木工程学院);Tongji University, State Key Laboratory of Disaster Reduction in Civil Engineering(同济大学,灾害防治工程重点实验室)