arXivDaily arXiv每日学术速递 周一至周五更新
arXiv physics/9803008physics.comp-phphysics.data-an
收藏

退火重要性抽样

Annealed Importance Sampling

Radford M. Neal

摘要:

模拟退火-通过一系列中间分布从易处理的分布移动到感兴趣的分布-传统上被用作处理马尔可夫链采样器中孤立模式的不精确方法。在这里,它示出了如何可以使用马尔可夫链转换这样的退火序列来定义一个重要性采样器。马尔可夫链方面允许该方法即使对于高维问题也可以接受地执行,其中找到良好的重要性采样分布否则将非常困难,而重要性权重的使用确保了随着退火运行次数的增加,找到的估计收敛到正确的值。这种退火的重要性采样过程类似于先前研究的回火过渡的后半部分,并且可以被看作是最近提出的顺序重要性采样的变体的概括。它也涉及到热力学积分法估计比率的归一化常数。退火重要性抽样是最有吸引力的孤立模式时,或当估计的归一化常数是必需的,但它也可能是更普遍的有用,因为它的独立采样允许一个绕过一些问题的评估收敛和自相关的马尔可夫链抽样。

英文摘要:

Simulated annealing - moving from a tractable distribution to a distribution of interest via a sequence of intermediate distributions - has traditionally been used as an inexact method of handling isolated modes in Markov chain samplers. Here, it is shown how one can use the Markov chain transitions for such an annealing sequence to define an importance sampler. The Markov chain aspect allows this method to perform acceptably even for high-dimensional problems, where finding good importance sampling distributions would otherwise be very difficult, while the use of importance weights ensures that the estimates found converge to the correct values as the number of annealing runs increases. This annealed importance sampling procedure resembles the second half of the previously-studied tempered transitions, and can be seen as a generalization of a recently-proposed variant of sequential importance sampling. It is also related to thermodynamic integration methods for estimating ratios of normalizing constants. Annealed importance sampling is most attractive when isolated modes are present, or when estimates of normalizing constants are required, but it may also be more generally useful, since its independent sampling allows one to bypass some of the problems of assessing convergence and autocorrelation in Markov chain samplers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑