arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1106.5941stat.CO
收藏

分裂哈密顿蒙特卡罗

Split Hamiltonian Monte Carlo

Babak Shahbaba, Shiwei Lan, Wesley O. Johnson, Radford M. Neal

摘要:

我们展示了如何哈密顿蒙特卡罗算法有时可以加快“分裂”的哈密尔顿的方式,允许大部分的运动在状态空间中以低的计算成本。这是可能的一个上下文是当感兴趣的分布的对数密度(势能函数)可以被写为高斯密度的对数时,高斯密度是二次函数,加上缓慢变化的函数。二次能量函数的哈密顿动力学可以解析求解。使用分裂技术,只有能量的缓慢变化部分需要进行数值处理,并且这可以用比直接模拟动力学所需的更大的步长(因此更少的步长)来完成。另一种情况下,分裂的帮助是当最重要的项的势能函数和它的梯度可以快速评估,只有一个缓慢变化的部分需要昂贵的计算。通过拆分,快速部分可以用较小的步长处理,而昂贵的部分使用较大的步长。我们表明,这两种分裂方法可以减少计算成本的采样从后验分布的逻辑斯谛回归模型,使用高斯近似集中在后验模式,或汉密尔顿分裂成一个术语,只依赖于少数的关键情况下,和另一个术语,涉及大量的情况下,其对后验分布的影响是小的。本文件的补充材料可在网上查阅。

英文摘要:

We show how the Hamiltonian Monte Carlo algorithm can sometimes be speeded up by "splitting" the Hamiltonian in a way that allows much of the movement around the state space to be done at low computational cost. One context where this is possible is when the log density of the distribution of interest (the potential energy function) can be written as the log of a Gaussian density, which is a quadratic function, plus a slowly varying function. Hamiltonian dynamics for quadratic energy functions can be analytically solved. With the splitting technique, only the slowly-varying part of the energy needs to be handled numerically, and this can be done with a larger stepsize (and hence fewer steps) than would be necessary with a direct simulation of the dynamics. Another context where splitting helps is when the most important terms of the potential energy function and its gradient can be evaluated quickly, with only a slowly-varying part requiring costly computations. With splitting, the quick portion can be handled with a small stepsize, while the costly portion uses a larger stepsize. We show that both of these splitting approaches can reduce the computational cost of sampling from the posterior distribution for a logistic regression model, using either a Gaussian approximation centered on the posterior mode, or a Hamiltonian split into a term that depends on only a small number of critical cases, and another term that involves the larger number of cases whose influence on the posterior distribution is small. Supplemental materials for this paper are available online.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑