压缩高斯过程
Compressed Gaussian Process
摘要:
大量样本(n)和特征(p)的非参数回归是一个越来越重要的问题。在大n设置中,常见的策略是划分特征空间,然后分别将简单模型应用于每个划分集。我们提出了一种替代方法,它避免了这样的分区和相关的敏感性邻域选择和距离度量,通过使用随机压缩结合高斯过程回归。所提出的方法是特别动机的设置中的响应是有条件的独立的功能给出的投影到一个低维流形。通过引入随机压缩矩阵和光滑度参数,得到了回归曲面的后验分布和后验预测分布。对许多随机压缩矩阵和平滑度参数并行运行分析,使用模型平均来组合结果。该算法可以快速实现,即使在非常大的n和p的问题,具有很强的理论依据,并发现产生最先进的预测性能。
英文摘要:
Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each partition set. We propose an alternative approach, which avoids such partitioning and the associated sensitivity to neighborhood choice and distance metrics, by using random compression combined with Gaussian process regression. The proposed approach is particularly motivated by the setting in which the response is conditionally independent of the features given the projection to a low dimensional manifold. Conditionally on the random compression matrix and a smoothness parameter, the posterior distribution for the regression surface and posterior predictive distributions are available analytically. Running the analysis in parallel for many random compression matrices and smoothness parameters, model averaging is used to combine the results. The algorithm can be implemented rapidly even in very big n and p problems, has strong theoretical justification, and is found to yield state of the art predictive performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。