Conditional score-based diffusion models for solving inverse problems in mechanics
University of Southern California(南加州大学);Harry Perkins Institute of Medical Research(哈里·珀金斯医学研究所);The University of Western Australia(西澳大学);Massachusetts Institute of Technology(麻省理工学院)
Agnimitra Dasgupta, Harisankar Ramaswamy, Javier Murgoitio-Esandi, Ken Foo, Runze Li, Qifa Zhou, Brendan Kennedy, Assad Oberai
我们提出了一个利用条件式基于分数扩散模型进行贝叶斯推断的框架,以求解一类力学反问题;这类问题涉及根据试样在载荷作用下力学响应的含噪测量,推断其空间变化的材料属性。条件式基于分数扩散模型属于生成模型,它利用来自联合分布的样本,学习近似条件分布的分数函数。更具体地说,对应于多次测量实现的分数函数由单一神经网络(即所谓的分数网络)近似;随后,使用基于 Langevin 动力学的适当 Markov chain Monte Carlo 方案,利用该网络对后验分布进行采样。训练分数网络只需要对正演模型进行仿真。因此,所提出的方法能够容纳黑箱正演模型和复杂的测量噪声。此外,分数网络一旦完成训练,便可重复用于求解不同测量实现下的反问题。我们在一系列高维力学反问题上证明了该方法的有效性,这些问题涉及从含噪测量中推断非均质材料属性。我们考虑的部分示例使用合成数据,其他示例则包含从实际弹性成像实验中采集的数据。进一步地,我们的应用表明,所提方法能够处理不同的测量模态、被推断量中的复杂模式、非高斯且非加性的噪声模型,以及非线性黑箱正演模型。结果表明,该框架能够高效求解大规模基于物理的反问题。
英文摘要:
We propose a framework to perform Bayesian inference using conditional score-based diffusion models to solve a class of inverse problems in mechanics involving the inference of a specimen's spatially varying material properties from noisy measurements of its mechanical response to loading. Conditional score-based diffusion models are generative models that learn to approximate the score function of a conditional distribution using samples from the joint distribution. More specifically, the score functions corresponding to multiple realizations of the measurement are approximated using a single neural network, the so-called score network, which is subsequently used to sample the posterior distribution using an appropriate Markov chain Monte Carlo scheme based on Langevin dynamics. Training the score network only requires simulating the forward model. Hence, the proposed approach can accommodate black-box forward models and complex measurement noise. Moreover, once the score network has been trained, it can be re-used to solve the inverse problem for different realizations of the measurements. We demonstrate the efficacy of the proposed approach on a suite of high-dimensional inverse problems in mechanics that involve inferring heterogeneous material properties from noisy measurements. Some examples we consider involve synthetic data, while others include data collected from actual elastography experiments. Further, our applications demonstrate that the proposed approach can handle different measurement modalities, complex patterns in the inferred quantities, non-Gaussian and non-additive noise models, and nonlinear black-box forward models. The results show that the proposed framework can solve large-scale physics-based inverse problems efficiently.
Conditional neural control variates for variance reduction in Bayesian inverse problems
Department of Computer Science University of Central Florida(计算机科学系佛罗里达中央大学);Department of Physics and Maryland Center for Fundamental Physics University of Maryland College Park(物理系马里兰根本物理中心马里兰大学学院公园分校)
Verifiable Regularity Criterion for Conditional Expectation Operators and Conditional Mean Embeddings with Applications to Nonparametric Regression, Bayesian Inverse Problems, and Koopman Operators
Technische Universität Ilmenau(伊尔梅瑙工业大学);Freie Universität Berlin(柏林自由大学);Chemnitz University of Technology(开姆尼茨工业大学)
An Unconditional Representation of the Conditional Score in Infinite-Dimensional Linear Inverse Problems
School of Engineering Science(工程科学学院);Lappeenranta-Lahti University of Technology(拉普兰塔-拉赫蒂技术大学);Vienna University of Technology (TU Wien)(维也纳技术大学);Department of Mathematics and Statistics(数学与统计学系);University of Helsinki(赫尔辛基大学);Department of Computational and Applied Mathematics(计算与应用数学系);Rice University(里士满大学)
Bayesian Inverse Problems Meet Flow Matching: Efficient and Flexible Inference via Transformers
Skolkovo Institute of Science and Technology(斯克洛夫学院科学与技术研究所);Sberbank(储蓄银行);AI4S Center(AI4S中心);Artificial Intelligence Research Institute(人工智能研究 institute)
An invertible generative model for forward and inverse problems
Centrum Wiskunde en Informatica, Amsterdam, The Netherlands(荷兰阿姆斯特丹数学与信息学研究中心);Utrecht University, Utrecht, The Netherlands(荷兰乌得勒支大学);University of Twente, Enschede, The Netherlands(荷兰埃因霍温大学)
A framework for data-driven solution and parameter estimation of PDEs using conditional generative adversarial networks
Cornell University(康奈尔大学);Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室);University of Hawai’i at Manoa(夏威夷大学马诺阿分校)
Guided Diffusion for Fast Inverse Design of Density-based Mechanical Metamaterials
School of Mathematical Sciences, University of Science and Technology of China(中国科学技术大学数学科学学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Hefei University of Technology(合肥工业大学)
Inverse design of 3d molecular structures with conditional generative neural networks
Technische Universität Berlin(柏林工业大学);Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所);Korea University(高丽大学);Max-Planck-Institut für Informatik(马克斯·普朗克信息学研究所)