Simulated tempering is popular method of allowing MCMC algorithms to move between modes of a multimodal target density π. One problem with simulated tempering for multimodal targets is that the weights of the various modes change for different inverse-temperature values, sometimes dramatically so. In this paper, we provide a fix to overcome this problem, by adjusting the mode weights to be preserved (i.e., constant) over different inverse-temperature settings. We then apply simulated tempering algorithms to multimodal targets using our mode weight correction. We present simulations in which our weight-preserving algorithm mixes between modes much more successfully than traditional tempering algorithms. We also prove a diffusion limit for an version of our algorithm, which shows that under appropriate assumptions, our algorithm mixes in time O(d [log d]^2).
在这篇简短的笔记中,我们展示了如何使用Bornn et al.(2013)的并行自适应Wang-Landau(PAWL)算法来自动化和改进模拟回火算法。虽然Wang-Landau和其他随机逼近方法经常被应用于模拟回火框架内,但本说明通过一个简单的例子演示了并行化、自适应建议和自动仓分裂带来的额外改进。
Accelerated Parallel Tempering via Neural Transports
University of Oxford(牛津大学);University of Cambridge(剑桥大学);Cornell University(康奈尔大学);Xaira Therapeutics;National University of Singapore(新加坡国立大学);University of British Columbia(不列颠哥伦比亚大学)