arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.26401stat.MLcs.LG
收藏

离群值鲁棒多输出高斯过程

Outlier-Robust Multi-Output Gaussian Processes

Econometric Institute, Erasmus University Rotterdam, The Netherlands(埃因霍温大学 Rotterdam 经济研究所);Department of Mathematics, University of Oslo, Norway(奥斯陆大学数学系);Department of Statistical Science, University College London, United Kingdom(伦敦大学学院统计学系)

Joshua Rooijakkers, Leiv Rønneberg, François-Xavier Briol, Jeremias Knoblauch, Matias Altamirano

AI总结:

本文针对多输出高斯过程(MOGP)易受离群值影响的问题,提出R-MOGP模型,该模型保留共轭性且计算效率高,实验显示其性能与现有最优鲁棒MOGP相当但成本更低。

摘要:

多输出高斯过程(MOGP)回归可对多个相关响应变量间的依赖关系进行建模。与标准高斯过程(GPs)类似,MOGPs对模型误设和离群值较为敏感,这类问题会扭曲单个输出内的预测结果;在多输出场景下,某一响应中的异常观测还会对其他相关输出的预测产生不利影响,进而加剧上述问题。为解决该问题,本文提出R-MOGP,这是一种经证明对任意单个响应中的离群值具有鲁棒性的MOGP。该方法保留了共轭性,在不牺牲计算效率的前提下实现了鲁棒性,且可与稀疏变分推理自然集成以提升可扩展性。实验表明,R-MOGP的性能可与现有最先进的鲁棒MOGPs相媲美,但计算成本仅为其一小部分。

英文摘要:

Multi-output Gaussian process (MOGP) regression allows modelling dependencies among multiple correlated response variables. Similarly to standard Gaussian processes (GPs), MOGPs are sensitive to model misspecification and outliers, which can distort predictions within individual outputs. In the multi-output case, this situation can be further exacerbated as anomalous observations in one response can adversely influence predictions for other correlated outputs. To handle this situation, we propose R-MOGP, an MOGP that is provably robust to outliers in any individual response. Our approach preserves conjugacy, achieving robustness without sacrificing computational efficiency, and integrates naturally with sparse variational inference for scalability. Empirically, we show that R-MOGP achieves performance comparable to existing state-of-the-art robust MOGPs at a fraction of their computational costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑