arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1604.00872stat.CO
收藏

几何回火哈密顿蒙特卡罗

Geometrically Tempered Hamiltonian Monte Carlo

Akihiko Nishimura, David Dunson

摘要:

哈密顿蒙特卡罗(HMC)已成为常规用于从后验分布采样。它的扩展黎曼流形HMC(RMHMC)修改的建议核通过变形的局部距离的黎曼度量。性能关键取决于度量的选择,其中费舍尔信息提供标准选择。在这篇文章中,我们提出了一类新的指标,旨在提高HMC的多模态目标分布的性能。我们将所提出的方法称为几何回火HMC(GTHMC),因为它与其他回火方法有关。我们建立了一个几何理论背后RMHMC激励GTHMC和表征其理论特性。此外,我们开发了一种新的可变步长积分器模拟哈密顿动力学,以改善通常的Störmer-Verlet积分器,该积分器在GTHMC设置中遭受数值不稳定性。我们说明GTHMC通过模拟,证明了通用性和实质性的收益超过标准的HMC实现的有效样本量。

英文摘要:

Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The performance depends critically on the choice of metric, with the Fisher information providing the standard choice. In this article, we propose a new class of metrics aimed at improving HMC's performance on multi-modal target distributions. We refer to the proposed approach as geometrically tempered HMC (GTHMC) due to its connection to other tempering methods. We establish a geometric theory behind RMHMC to motivate GTHMC and characterize its theoretical properties. Moreover, we develop a novel variable step size integrator for simulating Hamiltonian dynamics to improve on the usual Störmer-Verlet integrator which suffers from numerical instability in GTHMC settings. We illustrate GTHMC through simulations, demonstrating generality and substantial gains over standard HMC implementations in terms of effective sample sizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑