Gaussian processes provide a flexible framework for spatial prediction, but their computational cost limits applicability to large-scale data with large sample size $n$. Predictive processes (PPs), a popular low-rank approximation, mitigate this burden by projecting the original process onto a reduced set of $m\ll n$ inducing points. However, existing theory requires $m$ to grow with $n$, creating a trade-off between accuracy and computational efficiency. We address this challenge by introducing an ensemble of PPs based on spatial partitioning, and propose a novel partitioning and patching scheme with desirable properties. By generalizing the convergence results of PPs, it becomes possible to explicitly balance scalability and accuracy: increasing the number of ensemble components slows down the convergence but substantially improves computational efficiency. We further show theoretically that, despite the limited approximation accuracy of PPs with fixed, small $m$, they provide predictions that are more robust to training data contamination. Motivated by these findings, we finally introduce a multi-resolution ensemble that combines ensembles over possibly overlapping coarse to fine partitions. Unlike previous multi-resolution approaches, our method targets predictive robustness rather than accurate covariance approximation. Simulations and large-scale geostatistical applications demonstrate that our approach delivers accurate, robust predictions while being computationally efficient, thereby providing a practical and broadly applicable solution for spatial prediction.
Scalable Bayesian Monte Carlo: fast uncertainty estimation beyond deep ensembles
Mathematics Department, University of Manchester(曼彻斯特大学数学系);Department of Electrical and Computer Engineering, Southern Methodist University(南方 Methodist 大学电气与计算机工程系);DEVCOM US Army Research Laboratory(美国陆军研发实验室);Department of Electrical and Computer Engineering, University of Illinois Chicago(伊利诺伊大学芝加哥分校电气与计算机工程系);Cognizant AI Labs(Cognizant AI 实验室);Quantum Information Science Section, Oak Ridge National Laboratory(橡树岭国家实验室量子信息科学部门);Tulane University(Tulane 大学)