arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.06638cs.CV
收藏

自监督表示学习的局部提取算法

Distilling Localization for Self-Supervised Representation Learning

City University of Hong Kong(香港城市大学);Microsoft Research Asia(微软亚洲研究院)

Nanxuan Zhao, Zhirong Wu, Rynson W. H. Lau, Stephen Lin

摘要:

对比学习的最新进展彻底改变了无监督表示学习。具体地说,来自同一图像的多个视图(增强)被鼓励映射到类似的嵌入,而来自不同图像的视图被分开。在本文中,通过可视化和诊断分类错误,我们观察到,目前的对比模型是无效的,在定位前景对象,限制了他们的能力,以提取区分高层次的功能。这是由于视图生成过程均匀地考虑图像中的像素的事实。为了解决这个问题,我们提出了一种数据驱动的方法来学习背景不变性。它首先估计图像中的前景显著性,然后通过将前景复制并粘贴到各种背景上来创建增强。学习仍然遵循实例判别借口任务,因此表示被训练为忽略背景内容并专注于前景。我们研究了各种显着性估计方法,发现大多数方法导致对比学习的改进。通过这种方法(DiLo),ImageNet分类上的自监督学习以及PASCAL VOC和MSCOCO上的目标检测都实现了显著的性能。

英文摘要:

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different images are pulled apart. In this paper, through visualizing and diagnosing classification errors, we observe that current contrastive models are ineffective at localizing the foreground object, limiting their ability to extract discriminative high-level features. This is due to the fact that view generation process considers pixels in an image uniformly. To address this problem, we propose a data-driven approach for learning invariance to backgrounds. It first estimates foreground saliency in images and then creates augmentations by copy-and-pasting the foreground onto a variety of backgrounds. The learning still follows the instance discrimination pretext task, so that the representation is trained to disregard background content and focus on the foreground. We study a variety of saliency estimation methods, and find that most methods lead to improvements for contrastive learning. With this approach (DiLo), significant performance is achieved for self-supervised learning on ImageNet classification, and also for object detection on PASCAL VOC and MSCOCO.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑