arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03478cs.CVcs.LG

用于Fashion MNIST分类的卷积神经网络与视觉Transformer:文献综述

Convolutional Neural Networks and Vision Transformers for Fashion MNIST Classification: A Literature Review

ReGIM-Lab. REsearch Groups in Intelligent Machines(ReGIM-Lab 智能机器研究组)

Sonia Bbouzidi, Ghazala Hcini, Imen Jdey, Fadoua Drira

AI总结:

本文综述比较了CNNs与ViTs在Fashion MNIST服装分类中的性能,指出结合两者局部模式识别与全局上下文优势是提升电子商务图像分类的有效策略。

摘要:

我们的综述探讨了卷积神经网络(CNNs)与视觉Transformer(ViTs)在图像分类领域的比较分析,特别关注电子商务领域的服装分类。利用Fashion MNIST数据集,我们深入研究了CNNs和ViTs的独特属性。尽管CNNs长期以来一直是图像分类的基石,ViTs却引入了一种创新的自注意力机制,能够对输入数据的不同部分进行细致的权重分配。从历史上看,transformer主要与自然语言处理(NLP)任务相关联。通过对现有文献的全面考察,我们旨在揭示ViTs和CNNs在图像分类背景下的区别。我们的分析仔细审查了采用这两种架构的最先进方法,力求识别影响其性能的因素。这些因素包括数据集特征、图像尺寸、目标类别数量、硬件基础设施以及特定架构及其各自的最佳结果。我们的核心目标是在考虑特定条件和需求的情况下,确定ViT和CNN中哪种架构最适合在电子商务行业中对Fashion MNIST数据集的图像进行分类。我们强调了将这两种架构以不同形式结合以提升整体性能的重要性。通过联合这些架构,我们可以利用它们各自的优势,这可能会为电子商务应用带来更精确和可靠的模型。CNNs擅长识别局部模式,而ViTs能有效把握全局上下文,使得它们的结合成为提升图像分类性能的一种极具前景的策略。

英文摘要:

Our review explores the comparative analysis between Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in the domain of image classification, with a particular focus on clothing classification within the e-commerce sector. Utilizing the Fashion MNIST dataset, we delve into the unique attributes of CNNs and ViTs. While CNNs have long been the cornerstone of image classification, ViTs introduce an innovative self-attention mechanism enabling nuanced weighting of different input data components. Historically, transformers have primarily been associated with Natural Language Processing (NLP) tasks. Through a comprehensive examination of existing literature, our aim is to unveil the distinctions between ViTs and CNNs in the context of image classification. Our analysis meticulously scrutinizes state-of-the-art methodologies employing both architectures, striving to identify the factors influencing their performance. These factors encompass dataset characteristics, image dimensions, the number of target classes, hardware infrastructure, and the specific architectures along with their respective top results. Our key goal is to determine the most appropriate architecture between ViT and CNN for classifying images in the Fashion MNIST dataset within the e-commerce industry, while taking into account specific conditions and needs. We highlight the importance of combining these two architectures with different forms to enhance overall performance. By uniting these architectures, we can take advantage of their unique strengths, which may lead to more precise and reliable models for e-commerce applications. CNNs are skilled at recognizing local patterns, while ViTs are effective at grasping overall context, making their combination a promising strategy for boosting image classification performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑