软-硬标记转换的带冗余信息的高斯过程分类
Gaussian Process Classification with Privileged Information by Soft-to-Hard Labeling Transfer
摘要:
使用特权信息进行学习是一种有吸引力的问题设置,可以帮助现实世界中的许多学习场景。具有特权信息的高斯过程分类(GPC)的最新方法是GPC+,其将特权信息合并到似然的噪声项中。GPC+的一个缺点是,它需要数值求积来计算潜在函数的后验分布,这是非常耗时的。为了克服这一局限性,我们提出了一种新的分类方法与特权信息的基础上高斯过程,称为“软标签转移高斯过程(SLT-GP)。“我们的基本想法是,我们构建另一个学习任务,预测从特权信息中获得的软标签(连续值),并从这个任务到预测硬标签的目标任务进行迁移学习。我们推导出我们所提出的方法的PAC贝叶斯界,这证明了优化超参数的经验贝叶斯方法。我们还通过实验证明了我们所提出的方法与GPC和GPC+相比的实用性。
英文摘要:
Learning using privileged information is an attractive problem setting that helps many learning scenarios in the real world. A state-of-the-art method of Gaussian process classification (GPC) with privileged information is GPC+, which incorporates privileged information into a noise term of the likelihood. A drawback of GPC+ is that it requires numerical quadrature to calculate the posterior distribution of the latent function, which is extremely time-consuming. To overcome this limitation, we propose a novel classification method with privileged information based on Gaussian processes, called "soft-label-transferred Gaussian process (SLT-GP)." Our basic idea is that we construct another learning task of predicting soft labels (continuous values) obtained from privileged information and we perform transfer learning from this task to the target task of predicting hard labels. We derive a PAC-Bayesian bound of our proposed method, which justifies optimizing hyperparameters by the empirical Bayes method. We also experimentally show the usefulness of our proposed method compared with GPC and GPC+.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。