arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.09215cs.LGcs.AIstat.ML
收藏

关于拉普拉斯近似作为高斯过程模型选择准则的研究

On the Laplace Approximation as Model Selection Criterion for Gaussian Processes

University of Applied Sciences and Arts(应用科学与艺术大学);University of Hagen(哈根大学)

Andreas Besginow, Jan David Hüwel, Thomas Pawellek, Christian Beecks, Markus Lange-Hegermann

AI总结:

本文针对高斯过程模型选择,提出基于拉普拉斯近似的多种度量,克服了朴素应用的严重不一致性,在保证质量与动态嵌套采样相当的同时显著提升计算速度。

摘要:

模型选择旨在找到在准确性、可解释性或简洁性方面最优的模型,最好是同时满足这些标准。在本工作中,我们专注于评估高斯过程模型的性能,即寻找一个能在所有这些标准之间提供最佳权衡的度量标准。虽然先前的工作考虑了诸如似然、AIC或动态嵌套采样等度量,但它们要么性能不足,要么存在显著的运行时间问题,这严重限制了其适用性。我们通过引入多种基于拉普拉斯近似的度量来解决这些挑战,其中我们克服了在朴素应用拉普拉斯近似时出现的严重不一致性。实验表明,我们的度量在质量上与黄金标准动态嵌套采样相当,且不牺牲计算速度。我们的模型选择准则使得高斯过程模型的模型选择能够显著更快且质量更高。

英文摘要:

Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides the best trade-off between all those criteria. While previous work considers metrics like the likelihood, AIC or dynamic nested sampling, they either lack performance or have significant runtime issues, which severely limits applicability. We address these challenges by introducing multiple metrics based on the Laplace approximation, where we overcome a severe inconsistency occuring during naive application of the Laplace approximation. Experiments show that our metrics are comparable in quality to the gold standard dynamic nested sampling without compromising for computational speed. Our model selection criteria allow significantly faster and high quality model selection of Gaussian process models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑