arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.07073stat.MEstat.APstat.CO
收藏

带高斯过程先验的分层加性交互建模及其在多维网格数据中的高效实现

Hierarchical additive interaction modelling with Gaussian process prior and its efficient implementation for multidimensional grid data

University of Oxford(牛津大学);Sapienza University of Rome(罗马大学);London School of Economics and Political Science(伦敦政治经济学院)

Sahoko Ishida, Francesca Panero, Wicher Bergsma

AI总结:

针对加性高斯过程模型交互结构识别研究不足、计算存储成本高的问题,提出面向多维网格数据的快速分层加性交互GP模型,拓展克罗内克积计算适用范围,经模拟与实际数据验证有效。

摘要:

加性高斯过程(GP,Gaussian Process)模型为建模协变量间的复杂非线性关系与交互效应提供了灵活工具。现有研究大多聚焦于预测性能,对识别潜在交互结构的关注相对较少,而这类结构在许多应用中具备科学研究价值。实际应用中,加性GP模型因GP推理的三次计算成本与二次存储需求,在该场景下的应用受到限制。本文针对多维网格数据提出一种快速分层加性交互GP模型。模型以分层方差分析(ANOVA,Analysis of Variance)分解核为基础,在边际性原则下纳入主效应与交互效应。核中心化处理保证了模型可识别性,同时为低阶与高阶效应提供了唯一、可解释的分解方式。对于构成多维网格的数据集,通过利用协方差矩阵的克罗内克积(Kronecker product)结构实现了高效计算。本文的贡献在于将基于克罗内克积的计算方法拓展至所提出的分层加性GP模型类别内的任意交互结构,而以往方法仅适用于可分离或完全饱和的情况。通过模拟研究以及对伦敦高频二氧化氮浓度数据的应用,验证了所提方法的优势。

英文摘要:

Additive Gaussian process (GP) models offer flexible tools for modelling complex non-linear relationships and interaction effects among covariates. While most studies have focused on predictive performance, relatively little attention has been given to identifying the underlying interaction structure, which may be of scientific interest in many applications. In practice, the use of additive GP models in this context has been limited by the cubic computational cost and quadratic storage requirements of GP inference. This paper presents a fast hierarchical additive interaction GP model for multi-dimensional grid data. A hierarchical ANOVA decomposition kernel forms the foundation of our model, which incorporate main and interaction effects under the principle of marginality. Kernel centring ensures identifiability and provides a unique, interpretable decomposition of lower- and higher-order effects. For datasets forming a multi-dimensional grid, efficient implementation is achieved by exploiting the Kronecker product structure of the covariance matrix. Our contribution is to extend Kronecker-based computation to handle any interaction structure within the proposed class of hierarchical additive GP models, whereas previous methods were limited to separable or fully saturated cases. The benefits of the proposed approach are demonstrated through simulation studies and an application to high-frequency nitrogen dioxide concentration data in London.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑