使用相互作用粒子的贝叶斯采样
Bayesian sampling using interacting particles
AI总结:
本文综述相互作用粒子贝叶斯采样的平均场理论,介绍耦合方法与基于鞅的紧性论证,分别用于分析集成卡尔曼采样/反演和Vlasov-Boltzmann模拟器。
摘要:
贝叶斯采样是统计学和机器学习中的一项重要任务。在过去十年中,人们提出了许多集成型采样方法。与经典的马尔可夫链蒙特卡洛方法相比,这些新方法部署了大量交互式样本,而这些样本之间的通信对于加速收敛至关重要。为了证明这些采样策略的有效性,相互作用粒子的概念自然需要借助平均场理论。该理论在由一组耦合常微分方程/随机微分方程所编码的粒子相互作用,与刻画底层分布演化的偏微分方程之间建立了对应关系。这在数值算法与用于证明时间收敛性的偏微分方程理论之间架起了桥梁。人们发展了许多数学工具来提供平均场分析,我们展示了其中两个例子:耦合方法,以及建立在鞅策略之上的紧性论证。前者已被用于证明 ensemble Kalman sampler(集成卡尔曼采样器)和 ensemble Kalman inversion(集成卡尔曼反演)的收敛性,而后者将被证明在证明 Vlasov-Boltzmann simulator(弗拉索夫-玻尔兹曼模拟器)的有效性方面极为强大。
英文摘要:
Bayesian sampling is an important task in statistics and machine learning. Over the past decade, many ensemble-type sampling methods have been proposed. In contrast to the classical Markov chain Monte Carlo methods, these new methods deploy a large number of interactive samples, and the communication between these samples is crucial in speeding up the convergence. To justify the validity of these sampling strategies, the concept of interacting particles naturally calls for the mean-field theory. The theory establishes a correspondence between particle interactions encoded in a set of coupled ODEs/SDEs and a PDE that characterizes the evolution of the underlying distribution. This bridges numerical algorithms with the PDE theory used to show convergence in time. Many mathematical machineries are developed to provide the mean-field analysis, and we showcase two such examples: The coupling method and the compactness argument built upon the martingale strategy. The former has been deployed to show the convergence of ensemble Kalman sampler and ensemble Kalman inversion, and the latter will be shown to be immensely powerful in proving the validity of the Vlasov-Boltzmann simulator.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。