基于支持样本的非参数预测视图分类的视觉特征半监督学习
Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples
摘要:
本文提出了一种新的学习方法预测视图分配与支持样本(PAWS)。该方法训练模型以最小化一致性损失,这确保相同未标记实例的不同视图被分配类似的伪标签。通过将图像视图的表示与一组随机采样的标记图像的表示进行比较,非参数化地生成伪标签。视图表示和标记表示之间的距离用于提供类标签的权重,我们将其解释为软伪标签。通过以这种方式非参数化地合并标记样本,PAWS将BYOL和SwAV等自监督方法中使用的距离度量损失扩展到半监督设置。尽管这种方法很简单,但PAWS在架构上优于其他半监督方法,为ImageNet上的ResNet-50设置了一个新的最先进的水平,使用10%或1%的标签进行训练,分别达到75.5%和66.5%的top-1。PAWS需要的训练比以前的最佳方法少4倍到12倍。
英文摘要:
This paper proposes a novel method of learning by predicting view assignments with support samples (PAWS). The method trains a model to minimize a consistency loss, which ensures that different views of the same unlabeled instance are assigned similar pseudo-labels. The pseudo-labels are generated non-parametrically, by comparing the representations of the image views to those of a set of randomly sampled labeled images. The distance between the view representations and labeled representations is used to provide a weighting over class labels, which we interpret as a soft pseudo-label. By non-parametrically incorporating labeled samples in this way, PAWS extends the distance-metric loss used in self-supervised methods such as BYOL and SwAV to the semi-supervised setting. Despite the simplicity of the approach, PAWS outperforms other semi-supervised methods across architectures, setting a new state-of-the-art for a ResNet-50 on ImageNet trained with either 10% or 1% of the labels, reaching 75.5% and 66.5% top-1 respectively. PAWS requires 4x to 12x less training than the previous best methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。