arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1504.05753stat.COstat.AP
收藏

用于贝叶斯推断的高效序贯蒙特卡罗采样器

Efficient Sequential Monte-Carlo Samplers for Bayesian Inference

Thi Le Thu Nguyen, Francois Septier, Gareth W. Peters, Yves Delignon

摘要:

在许多问题中,需要复杂的非高斯和/或非线性模型来精确地描述感兴趣的物理系统。在这种情况下,蒙特卡罗算法是非常灵活和非常强大的方法来解决这样的推理问题。然而,在存在高维和/或多峰后验分布的情况下,广泛记载的是,标准蒙特卡罗技术可能导致性能不佳。本文的研究重点是一个序贯蒙特卡罗(SMC)采样器框架,一个更强大的和有效的蒙特卡罗算法。虽然这种方法比传统的蒙特卡罗方法具有许多优点,但这种新兴技术的潜力在信号处理中很大程度上尚未得到充分利用。在这项工作中,我们的目标是提出一些新的策略,将提高效率,并促进实际实施的SMC采样器,专门用于信号处理应用。首先,我们提出了一个自动和自适应的策略,选择序列的分布内的SMC采样器,最大限度地减少后验归一化常数的估计的渐近方差。这对于在贝叶斯信号处理中的建模应用中执行模型选择是至关重要的。我们提出的第二个原始贡献通过引入一种新的校正机制来提高SMC采样器的全局效率,该机制允许使用通过算法的所有迭代生成的粒子(而不是仅使用来自最后一次迭代的粒子)。这是一个重要的贡献,因为它消除了丢弃大部分获得的样品的需要,这在标准SMC方法中是标准的。这将提高实际环境中的估计性能,其中计算预算是重要的考虑因素。

英文摘要:

In many problems, complex non-Gaussian and/or nonlinear models are required to accurately describe a physical system of interest. In such cases, Monte Carlo algorithms are remarkably flexible and extremely powerful approaches to solve such inference problems. However, in the presence of a high-dimensional and/or multimodal posterior distribution, it is widely documented that standard Monte-Carlo techniques could lead to poor performance. In this paper, the study is focused on a Sequential Monte-Carlo (SMC) sampler framework, a more robust and efficient Monte Carlo algorithm. Although this approach presents many advantages over traditional Monte-Carlo methods, the potential of this emergent technique is however largely underexploited in signal processing. In this work, we aim at proposing some novel strategies that will improve the efficiency and facilitate practical implementation of the SMC sampler specifically for signal processing applications. Firstly, we propose an automatic and adaptive strategy that selects the sequence of distributions within the SMC sampler that minimizes the asymptotic variance of the estimator of the posterior normalization constant. This is critical for performing model selection in modelling applications in Bayesian signal processing. The second original contribution we present improves the global efficiency of the SMC sampler by introducing a novel correction mechanism that allows the use of the particles generated through all the iterations of the algorithm (instead of only particles from the last iteration). This is a significant contribution as it removes the need to discard a large portion of the samples obtained, as is standard in standard SMC methods. This will improve estimation performance in practical settings where computational budget is important to consider.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑