arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1807.09288stat.CO
收藏

全球共识蒙特卡罗

Global consensus Monte Carlo

Lewis J. Rendell, Adam M. Johansen, Anthony Lee, Nick Whiteley

摘要:

为了对大数据集进行贝叶斯推断,通常方便或有必要将数据分布在多台机器上。我们考虑一个似然函数表示为产品的条款,每个与一个子集的数据。受全局变量共识优化的启发,我们引入了一个工具层次模型,将辅助统计参数与每个术语相关联,这些参数在给定顶层参数的情况下是有条件独立的。这些顶级参数之一控制辅助参数之间的无条件关联强度。该模型导致一个分布式MCMC算法的扩展状态空间产生近似的后验期望。在计算易处理性和对原始模型的保真度之间的权衡可以通过改变工具模型中的关联强度来控制。我们进一步建议使用一个SMC采样器与序列的关联强度,允许自动确定适当的强度和偏差校正技术应用。与类似的分布式蒙特卡罗算法相比,这种方法需要很少的分布假设。的算法的性能示出了一些模拟的例子。

英文摘要:

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the data. Inspired by global variable consensus optimisation, we introduce an instrumental hierarchical model associating auxiliary statistical parameters with each term, which are conditionally independent given the top-level parameters. One of these top-level parameters controls the unconditional strength of association between the auxiliary parameters. This model leads to a distributed MCMC algorithm on an extended state space yielding approximations of posterior expectations. A trade-off between computational tractability and fidelity to the original model can be controlled by changing the association strength in the instrumental model. We further propose the use of a SMC sampler with a sequence of association strengths, allowing both the automatic determination of appropriate strengths and for a bias correction technique to be applied. In contrast to similar distributed Monte Carlo algorithms, this approach requires few distributional assumptions. The performance of the algorithms is illustrated with a number of simulated examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑