arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.16617cs.LGstat.MEstat.ML
收藏

高斯过程模型在高维输入下的最优核学习

Optimal Kernel Learning for Gaussian Process Models with High-Dimensional Input

University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校)

Lulu Kang, Minshen Xu

AI总结:

针对高维输入下高斯过程回归计算成本高、精度低的问题,提出基于凸组合核函数和Fedorov-Wynn算法的最优核学习方法,结合效应遗传原则识别活跃变量,提升预测精度并简化系统理解。

摘要:

高斯过程(GP)回归是工程和科学领域中计算机仿真的一种流行的代理建模工具。然而,当仿真涉及过多输入变量时,它常常面临计算成本高和预测精度低的问题。对于某些仿真模型,输出可能仅受输入变量的一小部分显著影响,这些变量被称为“活跃变量”。我们提出了一种最优核学习方法,用于识别这些活跃变量,从而克服GP模型的局限性并增强对系统的理解。我们的方法通过核函数的凸组合来近似原始GP模型的协方差函数,其中每个核函数利用输入变量的低维子集。受最优设计文献中的Fedorov-Wynn算法启发,我们开发了一种最优核学习算法来确定这种近似。我们引入了效应遗传原则,这是从“实验设计与分析”领域借鉴的概念,以确保活跃变量选择的稀疏性。通过多个示例,我们证明了所提出的方法在正确识别活跃输入变量和提高预测精度方面优于其他方法。它是解释代理GP回归和简化复杂底层系统的有效解决方案。

英文摘要:

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation involves too many input variables. For some simulation models, the outputs may only be significantly influenced by a small subset of the input variables, referred to as the ``active variables''. We propose an optimal kernel learning approach to identify these active variables, thereby overcoming GP model limitations and enhancing system understanding. Our method approximates the original GP model's covariance function through a convex combination of kernel functions, each utilizing low-dimensional subsets of input variables. Inspired by the Fedorov-Wynn algorithm from optimal design literature, we develop an optimal kernel learning algorithm to determine this approximation. We incorporate the effect heredity principle, a concept borrowed from the field of ``design and analysis of experiments'', to facilitate efficient computation. Through several examples, we demonstrate that the proposed method provides competitive prediction and variable selection, with favorable computational performance in the examples considered. It is an effective solution for interpreting the surrogate GP regression and simplifying the complex underlying system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑