非均质状态依赖偏微分方程的近似贝叶斯模型反演
Approximate Bayesian Model Inversion for PDEs with Heterogeneous and State-Dependent Coefficients
摘要:
针对参数空间依赖和状态依赖的偏微分方程(PDE)模型,提出了两种参数估计的近似贝叶斯推断方法。我们证明,这些方法提供了准确的和具有成本效益的替代马尔可夫链蒙特卡罗模拟。我们假设一个参数化的高斯先验的未知函数,并近似后验密度的参数化多元高斯密度。先验和后验的参数估计从偏微分方程模型的状态和未知函数本身的稀疏观测最大化的证据下限(ELBO),一个下界的对数边际似然观测。第一种方法,Laplace-EM,采用期望最大化算法来最大化ELBO,在E步上对后验进行拉普拉斯近似,并在M步上最小化库尔贝克-莱布勒散度。第二种方法,DSVI-EB,采用双随机变分推断(DSVI)算法,其中ELBO通过基于梯度的随机最优化最大化,噪声梯度通过简单的蒙特卡罗采样和高斯反向传播计算。我们应用这些方法来识别线性和非线性扩散方程中的扩散系数,我们发现,这两种方法提供了准确的估计后验密度和高斯先验的超参数。虽然Laplace-EM方法更精确,但它需要计算物理模型的Hessian。DSVI-EB方法被认为是不太准确,但只需要梯度的物理模型。
英文摘要:
We present two approximate Bayesian inference methods for parameter estimation in partial differential equation (PDE) models with space-dependent and state-dependent parameters. We demonstrate that these methods provide accurate and cost-effective alternatives to Markov Chain Monte Carlo simulation. We assume a parameterized Gaussian prior on the unknown functions, and approximate the posterior density by a parameterized multivariate Gaussian density. The parameters of the prior and posterior are estimated from sparse observations of the PDE model's states and the unknown functions themselves by maximizing the evidence lower bound (ELBO), a lower bound on the log marginal likelihood of the observations. The first method, Laplace-EM, employs the expectation maximization algorithm to maximize the ELBO, with a Laplace approximation of the posterior on the E-step, and minimization of a Kullback-Leibler divergence on the M-step. The second method, DSVI-EB, employs the doubly stochastic variational inference (DSVI) algorithm, in which the ELBO is maximized via gradient-based stochastic optimization, with nosiy gradients computed via simple Monte Carlo sampling and Gaussian backpropagation. We apply these methods to identifying diffusion coefficients in linear and nonlinear diffusion equations, and we find that both methods provide accurate estimates of posterior densities and the hyperparameters of Gaussian priors. While the Laplace-EM method is more accurate, it requires computing Hessians of the physics model. The DSVI-EB method is found to be less accurate but only requires gradients of the physics model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。