arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.17667astro-ph.IMastro-ph.COcs.LG
收藏

应对分布偏移问题:为逆问题校正错误设定、高维数据驱动的先验

Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems

Ciela Institute(Ciela研究所);Mila - Quebec Artificial Intelligence Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Center for Computational Astrophysics(计算天体物理中心);Flatiron Institute(弗拉蒂伦研究所);Perimeter Institute for Theoretical Physics(圆周理论物理研究所);Trottier Space Institute, McGill University(麦吉尔大学特罗蒂尔空间研究所)

Gabriel Missael Barco, Alexandre Adam, Connor Stone, Yashar Hezaveh, Laurence Perreault-Levasseur

AI总结:

本文针对天体物理逆问题中数据驱动先验因训练样本不可靠而出现错误设定的问题,提出通过后验样本迭代重训练模型来校正先验分布,并在强引力透镜背景重建中验证了该方法能逐步减小后验偏差。

摘要:

逆问题的贝叶斯推断关键取决于先验的选择。在缺乏具体先验信息的情况下,总体层面的分布可以作为感兴趣参数的有效先验。随着机器学习的兴起,使用数据驱动的总体层面分布(例如编码在训练好的深度神经网络中)作为先验,正在各种逆问题中成为简单参数化先验的有吸引力的替代方案。然而,在许多天体物理学应用中,获取来自感兴趣的真实数据生成过程的独立同分布样本来训练这些模型往往是困难的,甚至是不可能的。在这些情况下,通常使用被污染的数据或替代品(例如模拟器)来生成训练样本,这意味着存在获得错误设定先验的风险。这反过来又可能以难以量化的方式使推断出的后验产生偏差,从而限制了这些模型在现实场景中的潜在适用性。在这项工作中,我们提出通过使用来自不同观测集的后验样本重新训练模型来迭代更新总体层面分布,从而解决这一问题,并且我们在强引力透镜背景图像重建问题上展示了该方法的潜力,其中基于分数的模型被用作数据驱动的先验。我们表明,从一个错误设定的先验分布出发,更新后的分布逐渐变得更接近真实的总体层面分布,并且经过多次更新后,所得后验样本表现出减小的偏差。

英文摘要:

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of machine learning, the use of data-driven population-level distributions (encoded, e.g., in a trained deep neural network) as priors is emerging as an appealing alternative to simple parametric priors in a variety of inverse problems. However, in many astrophysical applications, it is often difficult or even impossible to acquire independent and identically distributed samples from the underlying data-generating process of interest to train these models. In these cases, corrupted data or a surrogate, e.g. a simulator, is often used to produce training samples, meaning that there is a risk of obtaining misspecified priors. This, in turn, can bias the inferred posteriors in ways that are difficult to quantify, which limits the potential applicability of these models in real-world scenarios. In this work, we propose addressing this issue by iteratively updating the population-level distributions by retraining the model with posterior samples from different sets of observations, and we showcase the potential of this method on the problem of background image reconstruction in strong gravitational lensing when score-based models are used as data-driven priors. We show that, starting from a misspecified prior distribution, the updated distribution becomes progressively closer to the underlying population-level distribution, and the resulting posterior samples exhibit reduced bias after several updates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑