arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1806.08694cs.IRcs.AI
收藏

变质量样本的学习排序

Learning to Rank from Samples of Variable Quality

University of Amsterdam(阿姆斯特丹大学)

Mostafa Dehghani, Jaap Kamps

摘要:

训练深度神经网络需要许多训练样本,但在实践中,获得训练标签的成本很高,并且质量可能不同,因为有些标签可能来自可信的专家标签,而其他标签可能来自物流或其他监管薄弱的来源,如众包。这在学习过程中造成了一个基本的质与量的权衡。我们是从少量的高质量数据中学习,还是从潜在的大量弱标记数据中学习?我们认为,如果学习者能够以某种方式知道,并考虑到标签质量时,学习的数据表示,我们可以得到最好的两个世界。为此,我们引入了“加权学习”(FWL),这是一种使用弱标记数据训练深度神经网络的半监督学生-教师方法。FWL根据教师(可以访问高质量标签)估计的标签质量的后验置信度,在每个样本的基础上调整学生网络(在我们关心的任务上训练)的参数更新。学生和老师都从数据中学习。我们评估FWL的文档排序,我们优于国家的最先进的替代半监督方法。

英文摘要:

Training deep neural networks requires many training samples, but in practice, training labels are expensive to obtain and may be of varying quality, as some may be from trusted expert labelers while others might be from heuristics or other sources of weak supervision such as crowd-sourcing. This creates a fundamental quality-versus quantity trade-off in the learning process. Do we learn from the small amount of high-quality data or the potentially large amount of weakly-labeled data? We argue that if the learner could somehow know and take the label-quality into account when learning the data representation, we could get the best of both worlds. To this end, we introduce "fidelity-weighted learning" (FWL), a semi-supervised student-teacher approach for training deep neural networks using weakly-labeled data. FWL modulates the parameter updates to a student network (trained on the task we care about) on a per-sample basis according to the posterior confidence of its label-quality estimated by a teacher (who has access to the high-quality labels). Both student and teacher are learned from the data. We evaluate FWL on document ranking where we outperform state-of-the-art alternative semi-supervised methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑