arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.12966cs.LGstat.ML
收藏

基于图的半监督学习中的标签噪声分析

Analysis of label noise in graph-based semi-supervised learning

Federal University of São Paulo(圣保罗联邦大学)

Bruno Klaus de Aquino Afonso, Lilian Berton

摘要:

在机器学习中,人们必须获取标签来帮助监督能够推广到看不见的数据的模型。然而,标记过程可能是繁琐的,漫长的,昂贵的,并且容易出错。通常情况下,我们的大部分数据都是未标记的。半监督学习(SSL)通过对标签和输入数据分布之间的关系做出强有力的假设来证明这一点。这种模式在实践中是成功的,但大多数SSL算法最终完全信任少数可用的标签。在现实生活中,人类和自动化系统都容易出错;我们的算法必须能够处理数量少且不可靠的标签。我们的工作旨在对现有的基于图的半监督算法进行广泛的经验评估,如高斯场和调和函数,局部和全局一致性,拉普拉斯特征映射,通过交替最小化的图转换。为了做到这一点,我们比较了分类器的准确性,同时改变了许多不同样本的标记数据和标记噪声的数量。我们的研究结果表明,如果数据集与SSL假设一致,我们能够检测到最嘈杂的实例,尽管当可用标签的数量减少时,这会变得更加困难。此外,当数据来自高维聚类时,Laplacian Eigenmaps算法的性能优于标签传播。

英文摘要:

In machine learning, one must acquire labels to help supervise a model that will be able to generalize to unseen data. However, the labeling process can be tedious, long, costly, and error-prone. It is often the case that most of our data is unlabeled. Semi-supervised learning (SSL) alleviates that by making strong assumptions about the relation between the labels and the input data distribution. This paradigm has been successful in practice, but most SSL algorithms end up fully trusting the few available labels. In real life, both humans and automated systems are prone to mistakes; it is essential that our algorithms are able to work with labels that are both few and also unreliable. Our work aims to perform an extensive empirical evaluation of existing graph-based semi-supervised algorithms, like Gaussian Fields and Harmonic Functions, Local and Global Consistency, Laplacian Eigenmaps, Graph Transduction Through Alternating Minimization. To do that, we compare the accuracy of classifiers while varying the amount of labeled data and label noise for many different samples. Our results show that, if the dataset is consistent with SSL assumptions, we are able to detect the noisiest instances, although this gets harder when the number of available labels decreases. Also, the Laplacian Eigenmaps algorithm performed better than label propagation when the data came from high-dimensional clusters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑