arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.09086stat.ML
收藏

相依多分辨高斯过程

Conditionally Independent Multiresolution Gaussian Processes

Jalil Taghia, Thomas B. Schön

摘要:

多分辨率高斯过程(GP)作为一种有效的提高GP近似质量的方法,在大规模数据中得到了越来越多的关注。目前的大多数结构都假定决议之间完全独立。这个假设简化了推理,但它低估了从一个分辨率转换到另一个分辨率的不确定性。这反过来又会导致模型在对所选分辨率过度敏感的意义上倾向于过拟合,以及在边界处不平滑的预测。我们的贡献是一个新的建设,而不是假设条件的独立性GP之间的决议。我们表明,放松完全独立的假设,使鲁棒性对过拟合,它提供的预测是平滑的边界。我们的新模型在2个合成数据集和9个真实数据集上与当前最先进的模型进行了比较。在大多数情况下,与基于完全独立假设的模型相比,我们的新条件独立构造表现良好。特别是,它几乎没有过度拟合的迹象。

英文摘要:

The multiresolution Gaussian process (GP) has gained increasing attention as a viable approach towards improving the quality of approximations in GPs that scale well to large-scale data. Most of the current constructions assume full independence across resolutions. This assumption simplifies the inference, but it underestimates the uncertainties in transitioning from one resolution to another. This in turn results in models which are prone to overfitting in the sense of excessive sensitivity to the chosen resolution, and predictions which are non-smooth at the boundaries. Our contribution is a new construction which instead assumes conditional independence among GPs across resolutions. We show that relaxing the full independence assumption enables robustness against overfitting, and that it delivers predictions that are smooth at the boundaries. Our new model is compared against current state of the art on 2 synthetic and 9 real-world datasets. In most cases, our new conditionally independent construction performed favorably when compared against models based on the full independence assumption. In particular, it exhibits little to no signs of overfitting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑