回滚哈密顿蒙特卡罗
Roll-back Hamiltonian Monte Carlo
摘要:
提出了一种新的哈密顿蒙特卡罗(HMC)框架,截断概率分布光滑的底层密度函数。传统的HMC需要计算与目标分布相关联的势函数的梯度,因此,由于缺乏连续性和可微性,因此不能对截尾分布执行其全部功率。在我们的框架中,我们在密度函数中引入了一个尖锐的S形因子来近似截断边界处的概率下降。目标势函数由一个新的势函数逼近,该势函数平滑地扩展到整个样本空间。然后对近似势进行HMC。虽然我们的方法很容易实现,并适用于广泛的问题,它也实现了可比的计算效率相比,其他基线方法在各种采样任务。RBHMC还为约束空间上的贝叶斯推断提供了一种新的方法。
英文摘要:
We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target distribution, and therefore does not perform its full power on truncated distributions due to lack of continuity and differentiability. In our framework, we introduce a sharp sigmoid factor in the density function to approximate the probability drop at the truncation boundary. The target potential function is approximated by a new potential which smoothly extends to the entire sample space. HMC is then performed on the approximate potential. While our method is easy to implement and applies to a wide range of problems, it also achieves comparable computational efficiency on various sampling tasks compared to other baseline methods. RBHMC also gives rise to a new approach for Bayesian inference on constrained spaces.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。