arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1308.2675astro-ph.IMastro-ph.CO
收藏

贝叶斯参数估计的抽样技术比较

Comparison of sampling techniques for Bayesian parameter estimation

Rupert Allison, Joanna Dunkley

摘要:

一组模型参数的后验概率分布编码了给定模型背景下数据必须告诉我们的所有信息;它是贝叶斯参数估计的基本量。为了推断后验概率分布,我们必须决定如何探索参数空间。在这里,我们比较了三种如何导航参数空间的处方,讨论它们的相对优点。我们考虑Metropolis-Hasting抽样,嵌套抽样和仿射不变的集成MCMC抽样。我们专注于他们的表现玩具模型高斯似然和现实世界的宇宙学数据集。我们概述了采样算法本身,并详细说明性能诊断,如收敛时间,范围并行化,尺寸缩放,必要的调整和非高斯分布的适用性。我们发现,嵌套抽样提供了高保真估计后验统计在低计算成本,并应在许多情况下,有利于大都会黑斯廷斯。当计算集群可以用于大规模并行化时,仿射不变MCMC具有竞争力。仿射不变MCMC和现有的扩展嵌套采样自然探测多模态和曲线分布。

英文摘要:

The posterior probability distribution for a set of model parameters encodes all that the data have to tell us in the context of a given model; it is the fundamental quantity for Bayesian parameter estimation. In order to infer the posterior probability distribution we have to decide how to explore parameter space. Here we compare three prescriptions for how parameter space is navigated, discussing their relative merits. We consider Metropolis-Hasting sampling, nested sampling and affine-invariant ensemble MCMC sampling. We focus on their performance on toy-model Gaussian likelihoods and on a real-world cosmological data set. We outline the sampling algorithms themselves and elaborate on performance diagnostics such as convergence time, scope for parallelisation, dimensional scaling, requisite tunings and suitability for non-Gaussian distributions. We find that nested sampling delivers high-fidelity estimates for posterior statistics at low computational cost, and should be adopted in favour of Metropolis-Hastings in many cases. Affine-invariant MCMC is competitive when computing clusters can be utilised for massive parallelisation. Affine-invariant MCMC and existing extensions to nested sampling naturally probe multi-modal and curving distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑