arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.10182stat.MEcs.CVeess.IVstat.ML
收藏

基于数据驱动先验的神经网络编码贝叶斯成像:理论、方法和算法

Bayesian Imaging With Data-Driven Priors Encoded by Neural Networks: Theory, Methods, and Algorithms

School of Mathematical and Computer Sciences, Heriot-Watt University(赫瑞瓦特大学数学与计算机科学学院);School of Mathematics, University of Edinburgh(爱丁堡大学数学学院);Maxwell Institute for Mathematical Sciences(麦克斯韦数学科学研究院)

Matthew Holden, Marcelo Pereyra, Konstantinos C. Zygalakis

摘要:

本文提出了一种新的方法来执行贝叶斯推断成像逆问题的先验知识是以训练数据的形式。遵循流形假设并采用生成建模方法,我们构建了一个数据驱动的先验,该先验支持在环境空间的一个子流形上,我们可以通过使用变分自动编码器或生成对抗网络从训练数据中学习。我们建立了相关的后验分布和后验矩的存在性和适定性,在易于验证的条件下,贝叶斯估计和不确定性量化分析提供了严格的基础。贝叶斯计算是通过使用一个并行的回火版本的预处理的克兰克-尼科尔森算法的流形上,这是遍历和鲁棒性的非凸性质,这些数据驱动的模型。除了点估计和不确定性量化分析,我们推导出一个模型误设定测试,自动检测的情况下,数据驱动的先验是不可靠的,并解释如何识别的潜在空间的尺寸直接从训练数据。所提出的方法与MNIST数据集,在那里它优于替代图像重建方法的最先进的一系列实验进行说明。模型精度分析表明,贝叶斯概率报告的数据驱动的模型也非常准确的概率下的频率定义。

英文摘要:

This paper proposes a new methodology for performing Bayesian inference in imaging inverse problems where the prior knowledge is available in the form of training data. Following the manifold hypothesis and adopting a generative modelling approach, we construct a data-driven prior that is supported on a sub-manifold of the ambient space, which we can learn from the training data by using a variational autoencoder or a generative adversarial network. We establish the existence and well-posedness of the associated posterior distribution and posterior moments under easily verifiable conditions, providing a rigorous underpinning for Bayesian estimators and uncertainty quantification analyses. Bayesian computation is performed by using a parallel tempered version of the preconditioned Crank-Nicolson algorithm on the manifold, which is shown to be ergodic and robust to the non-convex nature of these data-driven models. In addition to point estimators and uncertainty quantification analyses, we derive a model misspecification test to automatically detect situations where the data-driven prior is unreliable, and explain how to identify the dimension of the latent space directly from the training data. The proposed approach is illustrated with a range of experiments with the MNIST dataset, where it outperforms alternative image reconstruction approaches from the state of the art. A model accuracy analysis suggests that the Bayesian probabilities reported by the data-driven models are also remarkably accurate under a frequentist definition of probability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑