arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.08514cs.CVcs.LG
收藏

基于图像变换的自监督表示学习研究综述

Survey on Self-supervised Representation Learning Using Image Transformations

Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)

Muhammad Ali, Sayed Hashim

摘要:

深度神经网络需要大量的训练数据,而在现实世界中,可用于训练目的的数据稀缺。为了解决这些问题,自监督学习(SSL)方法被使用。SSL使用几何变换(GT)是一种简单而强大的技术,用于无监督表示学习。虽然多篇调查论文已经回顾了SSL技术,但没有一篇只关注使用几何变换的技术。此外,这些方法没有在审查它们的文件中深入讨论。我们提出这项工作的动机是几何变换已被证明是无监督表示学习中强大的监督信号。此外,许多这样的作品取得了巨大的成功,但没有得到太多的关注。我们提出了一个简洁的调查SSL的方法,使用几何变换。我们列出了六个使用图像变换的代表性模型,包括基于预测和自动编码变换的模型。我们回顾他们的架构以及学习方法。我们还比较了这些模型在CIFAR-10和ImageNet数据集上的对象识别任务中的性能。我们的分析表明,AETv 2在大多数设置中表现最佳。在某些设置中,具有特征解耦的旋转也表现良好。然后,我们从观察到的结果中获得见解。最后,我们总结的结果和见解,以及突出开放的问题要解决,并指出各种未来的方向。

英文摘要:

Deep neural networks need huge amount of training data, while in real world there is a scarcity of data available for training purposes. To resolve these issues, self-supervised learning (SSL) methods are used. SSL using geometric transformations (GT) is a simple yet powerful technique used in unsupervised representation learning. Although multiple survey papers have reviewed SSL techniques, there is none that only focuses on those that use geometric transformations. Furthermore, such methods have not been covered in depth in papers where they are reviewed. Our motivation to present this work is that geometric transformations have shown to be powerful supervisory signals in unsupervised representation learning. Moreover, many such works have found tremendous success, but have not gained much attention. We present a concise survey of SSL approaches that use geometric transformations. We shortlist six representative models that use image transformations including those based on predicting and autoencoding transformations. We review their architecture as well as learning methodologies. We also compare the performance of these models in the object recognition task on CIFAR-10 and ImageNet datasets. Our analysis indicates the AETv2 performs the best in most settings. Rotation with feature decoupling also performed well in some settings. We then derive insights from the observed results. Finally, we conclude with a summary of the results and insights as well as highlighting open problems to be addressed and indicating various future directions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑