面向基于模拟的推断的贝叶斯模型比较
Bayesian model comparison for simulation-based inference
AI总结:
针对基于模拟的推断场景下贝叶斯模型证据计算困难的问题,本研究利用学习调和均值估计量与后验样本生成方法解耦的特性,开发了适配三类神经密度估计方法的SBI模型比较技术,并通过多类问题验证了其有效性。
摘要:
选择合适的模型来描述观测数据是科学研究的一项基础任务。贝叶斯模型证据(也称为边际似然)是开展贝叶斯模型比较时需要估计的关键量,但其计算难度极大。我们提出了一种在基于模拟的推断(SBI,也常被称为无似然推断)场景下计算贝叶斯模型证据的方法。具体而言,我们利用了近期提出的学习调和均值估计量,并借助其与后验样本生成方法解耦的特性——即该估计量仅需后验样本,而样本可通过任意方法生成。许多其他计算模型证据的方法不具备这种灵活性,这一特性让我们能够为三大主流神经密度估计方法开发SBI模型比较技术,包括神经后验估计(NPE)、神经似然估计(NLE)和神经比率估计(NRE)。我们在一系列推断问题(包括一个引力波案例)上对所提出的SBI证据计算技术进行了演示和验证。此外,我们还在基于似然的场景中进一步验证了在HARMONIC软件中实现的学习调和均值估计量的准确性。这些结果凸显了HARMONIC作为一种与采样器无关的方法,在基于似然和基于模拟的两类场景下估计模型证据的潜力。
英文摘要:
Comparison of appropriate models to describe observational data is a fundamental task of science. The Bayesian model evidence, or marginal likelihood, is a computationally challenging, yet crucial, quantity to estimate to perform Bayesian model comparison. We introduce a methodology to compute the Bayesian model evidence in simulation-based inference (SBI) scenarios (also often called likelihood-free inference). In particular, we leverage the recently proposed learnt harmonic mean estimator and exploit the fact that it is decoupled from the method used to generate posterior samples, i.e. it requires posterior samples only, which may be generated by any approach. This flexibility, which is lacking in many alternative methods for computing the model evidence, allows us to develop SBI model comparison techniques for the three main neural density estimation approaches, including neural posterior estimation (NPE), neural likelihood estimation (NLE), and neural ratio estimation (NRE). We demonstrate and validate our SBI evidence calculation techniques on a range of inference problems, including a gravitational wave example. Moreover, we further validate the accuracy of the learnt harmonic mean estimator, implemented in the HARMONIC software, in likelihood-based settings. These results highlight the potential of HARMONIC as a sampler-agnostic method to estimate the model evidence in both likelihood-based and simulation-based scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。