计算量大的概率分布的贝叶斯优化
Bayesian optimization for computationally extensive probability distributions
摘要:
基于贝叶斯优化技术,提出了一种寻找计算量大的概率分布的最大值的有效方法。所提出的方法的一个关键思想是使用高斯过程的采集函数的极值用于下一个训练阶段,该训练阶段应该位于概率分布的局部最大值或全局最大值附近。我们的贝叶斯优化技术应用于后验分布的有效物理模型估计,这是一个计算广泛的概率分布。即使当后验分布上的采样点的数量固定为很小时,与随机搜索方法、最速下降方法或蒙特卡罗方法相比,贝叶斯优化提供了更好的后验分布的最大化。此外,贝叶斯优化通过结合最速下降法有效地改善了结果,因此它是一个强大的工具,以寻找一个更好的最大化的计算广泛的概率分布。
英文摘要:
An efficient method for finding a better maximizer of computationally extensive probability distributions is proposed on the basis of a Bayesian optimization technique. A key idea of the proposed method is to use extreme values of acquisition functions by Gaussian processes for the next training phase, which should be located near a local maximum or a global maximum of the probability distribution. Our Bayesian optimization technique is applied to the posterior distribution in the effective physical model estimation, which is a computationally extensive probability distribution. Even when the number of sampling points on the posterior distributions is fixed to be small, the Bayesian optimization provides a better maximizer of the posterior distributions in comparison to those by the random search method, the steepest descent method, or the Monte Carlo method. Furthermore, the Bayesian optimization improves the results efficiently by combining the steepest descent method and thus it is a powerful tool to search for a better maximizer of computationally extensive probability distributions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。