arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.08145cs.CV

结合自监督学习与带噪声标签的有监督学习

Combining Self-Supervised and Supervised Learning with Noisy Labels

Paradigm Inc.(第四范式公司);Tsinghua University(清华大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)

Yongqi Zhang, Hui Zhang, Quanming Yao, Jun Wan

AI总结:

针对CNN易过拟合噪声标签的问题,提出CS$^3$NL方法,利用自监督学习获取表示并直接用噪声标签训练分类器,在高噪声水平下大幅超越现有方法。

摘要:

由于卷积神经网络(CNNs)容易过拟合视觉分类任务中普遍存在的噪声标签,如何稳健地训练CNNs一直是一个巨大挑战。针对此挑战已提出多种方法。然而,它们均未关注CNNs表示学习与分类器学习之间的差异。因此,受分类器对噪声标签更稳健而表示更为脆弱这一观察的启发,并结合近期自监督表示学习(SSRL)技术的进展,我们设计了一种新方法CS$^3$NL:利用无标签的SSRL获取表示,并直接用噪声标签训练分类器。在合成与真实基准数据集上进行了大量实验。结果表明,该方法能大幅超越现有最先进方法,尤其是在高噪声水平下。

英文摘要:

Since convolutional neural networks (CNNs) can easily overfit noisy labels, which are ubiquitous in visual classification tasks, it has been a great challenge to train CNNs against them robustly. Various methods have been proposed for this challenge. However, none of them pay attention to the difference between representation and classifier learning of CNNs. Thus, inspired by the observation that classifier is more robust to noisy labels while representation is much more fragile, and by the recent advances of self-supervised representation learning (SSRL) technologies, we design a new method, i.e., CS$^3$NL, to obtain representation by SSRL without labels and train the classifier directly with noisy labels. Extensive experiments are performed on both synthetic and real benchmark datasets. Results demonstrate that the proposed method can beat the state-of-the-art ones by a large margin, especially under a high noisy level.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑