arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.10836cs.CV
收藏

PARS:用于噪声标签学习的伪标签感知鲁棒样本选择

PARS: Pseudo-Label Aware Robust Sample Selection for Learning with Noisy Labels

Amazon(亚马逊);University of Edinburgh(爱丁堡大学)

Arushi Goel, Yunlong Jiao, Jordan Massiah

摘要:

在大规模数据集上获取准确的标签既耗时又昂贵。为了减少深度学习模型对干净标签数据学习的依赖性,最近的几项研究工作都集中在带噪声标签的学习上。这些方法通常分为三个设计类别来学习噪声鲁棒模型:样本选择方法,噪声鲁棒损失函数或标签校正方法。在本文中,我们提出了PARS:伪标签感知鲁棒样本选择,这是一种混合方法,它在联合训练框架中结合了所有三个世界的最佳方法,以实现对噪声标签的鲁棒性。具体地说,PARS利用所有的训练样本,使用原始/噪声标签和估计/翻新的伪标签通过自我训练,通过损失分析将样本分为模糊和噪声子集,并为两组过滤标签设计标签相关的噪声感知损失函数。结果表明,PARS在对噪声CIFAR-10和CIFAR-100数据集的广泛研究中,特别是在具有挑战性的高噪声和低资源环境中,表现明显优于现有技术。特别是,PARS在具有90%对称标签噪声的CIFAR-100数据集上实现了测试准确度的绝对12%的提高,并且在训练期间只有1/5的噪声标签作为额外限制时,测试准确度的绝对27%的提高。在一个真实世界的噪声数据集上,Clothing 1 M,PARS实现了与最先进技术相比具有竞争力的结果。

英文摘要:

Acquiring accurate labels on large-scale datasets is both time consuming and expensive. To reduce the dependency of deep learning models on learning from clean labeled data, several recent research efforts are focused on learning with noisy labels. These methods typically fall into three design categories to learn a noise robust model: sample selection approaches, noise robust loss functions, or label correction methods. In this paper, we propose PARS: Pseudo-Label Aware Robust Sample Selection, a hybrid approach that combines the best from all three worlds in a joint-training framework to achieve robustness to noisy labels. Specifically, PARS exploits all training samples using both the raw/noisy labels and estimated/refurbished pseudo-labels via self-training, divides samples into an ambiguous and a noisy subset via loss analysis, and designs label-dependent noise-aware loss functions for both sets of filtered labels. Results show that PARS significantly outperforms the state of the art on extensive studies on the noisy CIFAR-10 and CIFAR-100 datasets, particularly on challenging high-noise and low-resource settings. In particular, PARS achieved an absolute 12% improvement in test accuracy on the CIFAR-100 dataset with 90% symmetric label noise, and an absolute 27% improvement in test accuracy when only 1/5 of the noisy labels are available during training as an additional restriction. On a real-world noisy dataset, Clothing1M, PARS achieves competitive results to the state of the art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑