arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.20596cs.CVcs.LG

基于自监督特征适应的广义半监督学习

Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation

Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)

Jiachen Liang, Ruibing Hou, Hong Chang, Bingpeng Ma, Shiguang Shan, Xilin Chen

AI总结:

提出自监督特征适应框架SSFA,通过解耦伪标签预测并引入自监督任务使特征提取器适应无标签数据分布,解决了有标签与无标签数据分布不一致导致的伪标签噪声累积问题,显著提升了半监督学习性能。

摘要:

传统半监督学习(SSL)假设有标签数据和无标签数据的特征分布是一致的,这在现实场景中很少成立。在本文中,我们提出了一种新的SSL设置,其中无标签样本来自偏离有标签样本特征分布的混合分布。在此设置下,先前的SSL方法倾向于使用拟合于有标签数据的模型预测错误的伪标签,导致噪声累积。为了解决这个问题,我们提出了自监督特征适应(SSFA),这是一个在有标签和无标签数据来自不同分布时提升SSL性能的通用框架。SSFA将伪标签的预测与当前模型解耦,以提高伪标签的质量。具体而言,SSFA将一个自监督任务整合到SSL框架中,并利用它使模型的特征提取器适应无标签数据。通过这种方式,提取的特征更好地契合无标签数据的分布,从而生成高质量的伪标签。大量实验表明,我们提出的SSFA适用于各种基于伪标签的SSL学习器,并在有标签、无标签甚至未见分布上显著提升了性能。

英文摘要:

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples are drawn from a mixed distribution that deviates from the feature distribution of labeled samples. Under this setting, previous SSL methods tend to predict wrong pseudo-labels with the model fitted on labeled data, resulting in noise accumulation. To tackle this issue, we propose Self-Supervised Feature Adaptation (SSFA), a generic framework for improving SSL performance when labeled and unlabeled data come from different distributions. SSFA decouples the prediction of pseudo-labels from the current model to improve the quality of pseudo-labels. Particularly, SSFA incorporates a self-supervised task into the SSL framework and uses it to adapt the feature extractor of the model to the unlabeled data. In this way, the extracted features better fit the distribution of unlabeled data, thereby generating high-quality pseudo-labels. Extensive experiments show that our proposed SSFA is applicable to various pseudo-label-based SSL learners and significantly improves performance in labeled, unlabeled, and even unseen distributions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑