消除一般 Hamiltonian 函数的 Hamiltonian Monte Carlo 算法的偏差
Unbiasing Hamiltonian Monte Carlo algorithms for a general Hamiltonian function
AI总结:
本文针对一般不可分离 Hamiltonian 函数导致 HMC 隐式格式产生偏差的问题,通过引入可逆性检查机制强制数值可逆性以实现无偏采样,并证明该算法可作为位置依赖扩散系数的 metropolized 过阻尼 Langevin 动力学的有效离散化。
摘要:
Hamiltonian Monte Carlo (HMC) 是一种 Markov chain Monte Carlo 方法,能够对高维概率测度进行采样。它依赖于 Hamiltonian 动力学的积分来提出一个移动,然后通过 Metropolis 过程接受或拒绝该移动。无偏采样由数值积分器保持 Hamiltonian 动力学的两个关键特性来保证:保体积性和动量反转下的可逆性。对于可分离的 Hamiltonian 函数,一些标准的显式数值格式,如 Störmer-Verlet 积分器,满足这些特性。然而,出于数值或物理原因,人们可能会考虑不可分离的 Hamiltonian 函数,在这种情况下,保持体积并满足动量反转下可逆性的标准数值格式是隐式的。在实际实现中,这种隐式格式可能有许多解或无解,特别是当时间步长过大时。我们在此展示了如何通过引入可逆性检查,在这种背景下强制执行 HMC 格式的数值可逆性,从而保证无偏性。此外,对于某些特定形式的 Hamiltonian 函数,我们讨论了这些 HMC 格式与某些 Langevin 动力学的一致性,并特别表明我们的算法产生了具有位置依赖扩散系数的 metropolized 过阻尼 Langevin 动力学的有效离散化。数值结果说明了可逆性检查在简单问题上的相关性。
英文摘要:
Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo method that allows to sample high dimensional probability measures. It relies on the integration of the Hamiltonian dynamics to propose a move which is then accepted or rejected thanks to a Metropolis procedure. Unbiased sampling is guaranteed by the preservation by the numerical integrators of two key properties of the Hamiltonian dynamics: volume-preservation and reversibility up to momentum reversal. For separable Hamiltonian functions, some standard explicit numerical schemes, such as the Störmer-Verlet integrator, satisfy these properties. However, for numerical or physical reasons, one may consider a Hamiltonian function which is nonseparable, in which case the standard numerical schemes which preserve the volume and satisfy reversibility up to momentum reversal are implicit. When implemented in practice, such implicit schemes may admit many solutions or none, especially when the timestep is too large. We show here how to enforce the numerical reversibility, and thus unbiasedness, of HMC schemes in this context by introducing a reversibility check. In addition, for some specific forms of the Hamiltonian function, we discuss the consistency of these HMC schemes with some Langevin dynamics, and show in particular that our algorithm yields an efficient discretization of the metropolized overdamped Langevin dynamics with position-dependent diffusion coefficients. Numerical results illustrate the relevance of the reversibility check on simple problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。