arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.06300stat.MEcs.AIcs.LGstat.CO

DG-LMC: A Turn-key and Scalable Synchronous Distributed MCMC Algorithm via Langevin Monte Carlo within Gibbs

Lagrange Mathematics and Computing Research Center(拉格朗日数学与计算研究中心);Ecole Polytechnique(巴黎综合理工学院);Université Paris-Saclay(巴黎萨克雷大学);Ecole Normale Supérieure Paris-Saclay(巴黎-萨克雷高等师范学院)

Vincent Plassier, Maxime Vono, Alain Durmus, Eric Moulines

英文摘要:

Performing reliable Bayesian inference on a big data scale is becoming a keystone in the modern era of machine learning. A workhorse class of methods to achieve this task are Markov chain Monte Carlo (MCMC) algorithms and their design to handle distributed datasets has been the subject of many works. However, existing methods are not completely either reliable or computationally efficient. In this paper, we propose to fill this gap in the case where the dataset is partitioned and stored on computing nodes within a cluster under a master/slaves architecture. We derive a user-friendly centralised distributed MCMC algorithm with provable scaling in high-dimensional settings. We illustrate the relevance of the proposed methodology on both synthetic and real data experiments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑