arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1704.03338stat.CO
收藏

连续回火哈密顿蒙特卡罗

Continuously tempered Hamiltonian Monte Carlo

Matthew M. Graham, Amos J. Storkey

摘要:

哈密顿蒙特卡罗(HMC)方法是一种用于连续变量复杂概率模型近似推理的马尔可夫链蒙特卡罗(MCMC)方法。然而,与许多MCMC方法一样,标准HMC方法在具有多个孤立模式的分布中表现不佳。我们提出了一种方法,用于增加一个额外的连续的温度控制变量,它允许动态之间的桥梁采样复杂的目标分布和一个简单的单峰基础分布的哈密顿系统。这种增强既有助于改善多模态目标的混合,又允许估计目标分布的归一化常数。该方法在现有的HMC代码中实现简单,只需要一个标准的蛙跳积分器。我们的实验表明,该方法是有竞争力的退火重要性抽样和模拟回火方法在采样具有挑战性的多峰分布和估计其归一化常数。

英文摘要:

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC approach performs poorly in distributions with multiple isolated modes. We present a method for augmenting the Hamiltonian system with an extra continuous temperature control variable which allows the dynamic to bridge between sampling a complex target distribution and a simpler unimodal base distribution. This augmentation both helps improve mixing in multimodal targets and allows the normalisation constant of the target distribution to be estimated. The method is simple to implement within existing HMC code, requiring only a standard leapfrog integrator. We demonstrate experimentally that the method is competitive with annealed importance sampling and simulating tempering methods at sampling from challenging multimodal distributions and estimating their normalising constants.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑