We consider Bayesian inverse problems arising in data assimilation for dynamical systems governed by partial and stochastic partial differential equations. The space-time dependent field is inferred jointly with static parameters of the prior and likelihood densities. Particular emphasis is placed on the hyperparameter controlling the prior smoothness and regularity, which is critical in ensuring well-posedness, shaping posterior structure, and determining predictive uncertainty. Commonly it is assumed to be known and fixed a priori; however in this paper we will adopt a hierarchical Bayesian framework in which smoothness and other hyperparameters are treated as unknown and assigned hyperpriors. Posterior inference is performed using Metropolis-within-Gibbs sampling suitable to high dimensions, for which hyperparameter estimation involves little computational overhead. The methodology is demonstrated on inverse problems for the Navier-Stokes equations and the stochastic advection-diffusion equation, under sparse and dense observation regimes, using Gaussian priors with different covariance structure. Numerical results show that jointly estimating the smoothness substantially reduces the errors in uncertainty quantification and parameter estimation induced by smoothness misspecification, by achieving performance comparable to scenarios in which the true smoothness is known.
Regularity-informed data assimilation: A hierarchical Bayesian approach to ensemble Kalman filtering for hyperbolic conservation laws
Division of Applied Mathematics, Linköping University(林雪平大学应用数学系);Center for Computational Science and Engineering, Massachusetts Institute of Technology(麻省理工学院计算科学与工程中心)
Hyperparameter Selection via Early Stopping for Bayesian Semilinear PDEs
Institut de Mathématiques de Toulouse, Université de Toulouse, INSA(图卢兹数学研究所,图卢兹大学,法国国立应用科学学院);Institut für Mathematik, Technische Universität Ilmenau(数学研究所,埃尔朗根-纽伦堡工业大学)
Regime-Adaptive Bayesian Optimization via Dirichlet Process Mixtures of Gaussian Processes
Department of Computer Science, Florida State University(佛罗里达州立大学计算机科学系);Department of Computer Science, University of Chicago(芝加哥大学计算机科学系);School of Mechanical Engineering, Purdue University(普渡大学机械工程学院);College of Nanotechnology, Science, and Engineering, State University of New York at Albany(纽约州立大学阿尔巴尼分校纳米技术、科学与工程学院)