arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.14591stat.COstat.ME
收藏

基于相关性的稀疏逆Cholesky分解用于快速高斯过程推断

Correlation-based sparse inverse Cholesky factorization for fast Gaussian-process inference

Myeongjong Kang, Matthias Katzfuss

AI总结:

提出基于相关性的距离度量进行稀疏逆Cholesky分解,以实现快速高斯过程推断,在复杂协方差结构下提升近似精度并实现自动化应用。

摘要:

高斯过程在统计学和机器学习中被广泛用作未知函数的先验。为了在大数据集上实现计算上可行的推断,一种流行的方法是Vecchia近似,这是一种数据向量的有序条件近似,意味着精度矩阵具有稀疏的Cholesky因子。排序和稀疏模式通常基于与数据点对应的输入或位置的欧几里得距离来确定。在此,我们提出使用基于相关性的距离度量,它在隐式上于合适的变换输入空间中应用Vecchia近似。基于相关性的算法可以在与数据集大小呈准线性的时间内完成,因此即使对于相关结构中未知参数的迭代推断也能适用。在复杂环境中,基于相关性的方法具有两个优势:它可以产生更准确的近似,并提供一种简单、自动的策略,可应用于任何协方差,甚至在欧几里得距离不适用时也能使用。我们在多种设置中展示了这些优势,包括各向异性、非平稳、多变量以及时空过程。我们还在由区域气候模型生成的多变量时空温度场上说明了该方法。

英文摘要:

Gaussian processes are widely used as priors for unknown functions in statistics and machine learning. To achieve computationally feasible inference for large datasets, a popular approach is the Vecchia approximation, which is an ordered conditional approximation of the data vector that implies a sparse Cholesky factor of the precision matrix. The ordering and sparsity pattern are typically determined based on Euclidean distance of the inputs or locations corresponding to the data points. Here, we propose instead to use a correlation-based distance metric, which implicitly applies the Vecchia approximation in a suitable transformed input space. The correlation-based algorithm can be carried out in quasilinear time in the size of the dataset, and so it can be applied even for iterative inference on unknown parameters in the correlation structure. The correlation-based approach has two advantages for complex settings: It can result in more accurate approximations, and it offers a simple, automatic strategy that can be applied to any covariance, even when Euclidean distance is not applicable. We demonstrate these advantages in several settings, including anisotropic, nonstationary, multivariate, and spatio-temporal processes. We also illustrate our method on multivariate spatio-temporal temperature fields produced by a regional climate model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑