非恰当高斯过程中无均值回复的平稳性
Stationarity without mean reversion in improper Gaussian processes
AI总结:
针对非周期性平稳协方差函数的均值回复特性在处理非收敛到固定均值数据时的病态问题,提出基于无穷方差非恰当高斯过程先验的非正定核,得到平稳无均值回复的过程,解析后验易计算,保留常用平滑核特性且解决病态问题。
摘要:
高斯过程(GP)回归的表现取决于协方差函数的选择,平稳协方差函数在机器学习应用中备受青睐。然而,(非周期性的)平稳协方差函数始终具备均值回复特性,因此在应用于不会收敛到固定全局均值的数据时,可能会出现病态行为。本文证明,使用具有无穷方差的非恰当GP先验,可以定义具备平稳性但无均值回复特性的过程。为实现这一目标,我们采用了仅能在该极限情形下定义的非正定核。由此得到的后验分布可通过解析方式计算,仅需对常用公式做简单修正。本文的核心贡献是引入了一大类平滑的非回复协方差函数,它们与GP文献中常用的核(如平方指数核和Matérn类核)高度相似。通过对合成数据和真实数据的分析,我们证明这些非正定核解决了均值回复GP回归的一些已知病态问题,同时保留了普通平滑平稳核的大部分优良特性。
英文摘要:
The behavior of a GP regression depends on the choice of covariance function. Stationary covariance functions are preferred in machine learning applications. However, (non-periodic) stationary covariance functions are always mean reverting and can therefore exhibit pathological behavior when applied to data that does not relax to a fixed global mean value. In this paper we show that it is possible to use improper GP priors with infinite variance to define processes that are stationary but not mean reverting. To this aim, we use of non-positive kernels that can only be defined in this limit regime. The resulting posterior distributions can be computed analytically and it involves a simple correction of the usual formulas. The main contribution of the paper is the introduction of a large family of smooth non-reverting covariance functions that closely resemble the kernels commonly used in the GP literature (e.g. squared exponential and Matérn class). By analyzing both synthetic and real data, we demonstrate that these non-positive kernels solve some known pathologies of mean reverting GP regression while retaining most of the favorable properties of ordinary smooth stationary kernels.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。