arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.03015stat.MLcs.LG
收藏

四重随机高斯过程

Quadruply Stochastic Gaussian Processes

University of Toronto(多伦多大学)

Trefor W. Evans, Prasanth B. Nair

摘要:

我们引入了一个随机变分推断过程训练可扩展高斯过程(GP)模型,其每次迭代的复杂性是独立的训练点的数量,$n$,和核近似,$m$中使用的数量基函数。我们的主要贡献包括一个无偏随机估计的证据下限(ELBO)的高斯似然,以及一个随机估计,下界ELBO的其他几个似然,如拉普拉斯和逻辑。$n$和$m$上的随机最优化更新复杂度的独立性使得能够使用大容量GP模型对巨大数据集进行推断。我们展示了准确的推理大型分类和回归数据集使用GP和相关向量机高达$m = 10^7$基函数。

英文摘要:

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in the kernel approximation, $m$. Our central contributions include an unbiased stochastic estimator of the evidence lower bound (ELBO) for a Gaussian likelihood, as well as a stochastic estimator that lower bounds the ELBO for several other likelihoods such as Laplace and logistic. Independence of the stochastic optimization update complexity on $n$ and $m$ enables inference on huge datasets using large capacity GP models. We demonstrate accurate inference on large classification and regression datasets using GPs and relevance vector machines with up to $m = 10^7$ basis functions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑