arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.07368cs.CV
收藏

基于多视图自标记的信息最大化聚类

Information Maximization Clustering via Multi-View Self-Labelling

University of Surrey(萨里大学);National Physical Laboratory(国家物理实验室)

Foivos Ntelemis, Yaochu Jin, Spencer A. Thomas

AI总结:

本文提出一种单阶段图像聚类方法,通过分类器网络将离散表示集成到自监督学习中,并在多裁剪视图上最大化互信息,在CIFAR-10和CIFAR-100/20上分别取得89.1%和49.0%的平均准确率,超越现有技术且对参数设置具有鲁棒性。

摘要:

图像聚类是一项特别具有挑战性的计算机视觉任务,其目标是在没有人类监督的情况下生成标注。近期研究进展集中在图像聚类中使用自监督学习策略,即首先学习有价值的语义信息,然后对图像表示进行聚类。然而,这些多阶段算法增加了计算时间,且其最终性能依赖于第一阶段。通过扩展自监督方法,我们提出了一种新颖的单阶段聚类方法,能够同时学习有意义的表示并分配相应的标注。这是通过分类器网络将离散表示集成到自监督范式中实现的。具体而言,所提出的聚类目标采用互信息,并最大化集成的离散表示与离散概率分布之间的依赖关系。离散概率分布通过自监督过程推导得出,该过程将学习到的潜在表示与一组可训练原型进行比较。为了提升分类器的学习性能,我们在多裁剪视图上联合应用互信息。我们的实验结果表明,所提出的框架在CIFAR-10和CIFAR-100/20数据集上分别以89.1%和49.0%的平均准确率超越了最先进的技术。最后,所提出的方法还展示了对参数设置的良好鲁棒性,使其能够适用于其他数据集。

英文摘要:

Image clustering is a particularly challenging computer vision task, which aims to generate annotations without human supervision. Recent advances focus on the use of self-supervised learning strategies in image clustering, by first learning valuable semantics and then clustering the image representations. These multiple-phase algorithms, however, increase the computational time and their final performance is reliant on the first stage. By extending the self-supervised approach, we propose a novel single-phase clustering method that simultaneously learns meaningful representations and assigns the corresponding annotations. This is achieved by integrating a discrete representation into the self-supervised paradigm through a classifier net. Specifically, the proposed clustering objective employs mutual information, and maximizes the dependency between the integrated discrete representation and a discrete probability distribution. The discrete probability distribution is derived though the self-supervised process by comparing the learnt latent representation with a set of trainable prototypes. To enhance the learning performance of the classifier, we jointly apply the mutual information across multi-crop views. Our empirical results show that the proposed framework outperforms state-of-the-art techniques with the average accuracy of 89.1% and 49.0%, respectively, on CIFAR-10 and CIFAR-100/20 datasets. Finally, the proposed method also demonstrates attractive robustness to parameter settings, making it ready to be applicable to other datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑