arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.02045astro-ph.COastro-ph.IMstat.MEstat.ML
收藏

基于高斯过程的快速鲁棒贝叶斯推断:GPry 算法

Fast and robust Bayesian Inference using Gaussian Processes with GPry

Jonas El Gammal, Nils Schöneberg, Jesús Torrado, Christian Fidler

AI总结:

本研究提出无需预训练和专用硬件的 GPry 贝叶斯推断算法,结合高斯过程代理模型、支持向量机分类器与主动学习,大幅减少后验评估次数,在秒级以上似然评估场景下显著优于传统蒙特卡洛方法,已开源为 Python 包。

摘要:

我们提出了 GPry 算法,用于对中等参数数量的通用(非高斯)后验分布进行快速贝叶斯推断。GPry 无需任何预训练,也不需要 GPU 等专用硬件,旨在作为传统贝叶斯推断蒙特卡洛方法的直接替代方案。\n该算法基于生成对数后验的高斯过程(Gaussian Process)代理模型,并借助支持向量机(Support Vector Machine)分类器排除极端值或非有限值。主动学习方案使我们所需的后验评估次数与传统蒙特卡洛推断相比减少了两个数量级。算法支持在最优位置并行进行后验评估,进一步缩短了实际运行时间。我们通过在主动学习方案中利用后验特性并定义高斯过程先验,显著提升了性能,尤其考虑了不同维度下后验的预期动态范围。\n我们在多个合成数据集和宇宙学案例上测试了该模型。当似然评估(或理论可观测量计算)时间在秒级时,GPry 性能优于传统蒙特卡洛方法;当评估时间超过一分钟时,它仅需数天即可完成传统方法需要数月的推断任务。GPry 以开源 Python 包形式发布(可通过 pip install gpry 安装),也可在 https://github.com/jonaselgammal/GPry 获取。

英文摘要:

We present the GPry algorithm for fast Bayesian inference of general (non-Gaussian) posteriors with a moderate number of parameters. GPry does not need any pre-training, special hardware such as GPUs, and is intended as a drop-in replacement for traditional Monte Carlo methods for Bayesian inference. Our algorithm is based on generating a Gaussian Process surrogate model of the log-posterior, aided by a Support Vector Machine classifier that excludes extreme or non-finite values. An active learning scheme allows us to reduce the number of required posterior evaluations by two orders of magnitude compared to traditional Monte Carlo inference. Our algorithm allows for parallel evaluations of the posterior at optimal locations, further reducing wall-clock times. We significantly improve performance using properties of the posterior in our active learning scheme and for the definition of the GP prior. In particular we account for the expected dynamical range of the posterior in different dimensionalities. We test our model against a number of synthetic and cosmological examples. GPry outperforms traditional Monte Carlo methods when the evaluation time of the likelihood (or the calculation of theoretical observables) is of the order of seconds; for evaluation times of over a minute it can perform inference in days that would take months using traditional methods. GPry is distributed as an open source Python package (pip install gpry) and can also be found at https://github.com/jonaselgammal/GPry.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑