arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1509.01168stat.MLcs.AIcs.LGmath.PR
收藏

高斯过程的半描述半监督学习

Semi-described and semi-supervised learning with Gaussian processes

The University of Sheffield(谢菲尔德大学)

Andreas Damianou, Neil D. Lawrence

摘要:

通过非线性高斯过程(GP)映射传播输入不确定性是棘手的。这阻碍了使用不确定和部分观察到的输入来训练GP的任务。在本文中,我们把这个任务称为“半描述学习”。然后,我们引入了一个GP框架,解决了半描述和半监督学习问题(其中输出中出现缺失值)。自回归状态空间模拟也被认为是半描述学习的特殊情况。为了实现我们的目标,我们开发了变分方法处理半描述的输入GP,并将它们与算法,允许输入的缺失值,同时处理的不确定性在一个原则,贝叶斯的方式。模拟和真实世界的数据进行了大量的实验,研究了迭代预测和回归/分类与缺失值的问题。结果表明,原则性传播的不确定性来自我们的框架可以显着提高这些任务的性能。

英文摘要:

Propagating input uncertainty through non-linear Gaussian process (GP) mappings is intractable. This hinders the task of training GPs using uncertain and partially observed inputs. In this paper we refer to this task as "semi-described learning". We then introduce a GP framework that solves both, the semi-described and the semi-supervised learning problems (where missing values occur in the outputs). Auto-regressive state space simulation is also recognised as a special case of semi-described learning. To achieve our goal we develop variational methods for handling semi-described inputs in GPs, and couple them with algorithms that allow for imputing the missing values while treating the uncertainty in a principled, Bayesian manner. Extensive experiments on simulated and real-world data study the problems of iterative forecasting and regression/classification with missing values. The results suggest that the principled propagation of uncertainty stemming from our framework can significantly improve performance in these tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑