arXiv 2204.085842022-04-18cs.CV

A Region-Based Deep Learning Approach to Automated Retail Checkout

University of Missouri-Columbia（密苏里大学哥伦比亚分校）

Maged Shoman, Armstrong Aboah, Alex Morehead, Ye Duan, Abdulateef Daud, Yaw Adu-Gyamfi

英文摘要：

Automating the product checkout process at conventional retail stores is a task poised to have large impacts on society generally speaking. Towards this end, reliable deep learning models that enable automated product counting for fast customer checkout can make this goal a reality. In this work, we propose a novel, region-based deep learning approach to automate product counting using a customized YOLOv5 object detection pipeline and the DeepSORT algorithm. Our results on challenging, real-world test videos demonstrate that our method can generalize its predictions to a sufficient level of accuracy and with a fast enough runtime to warrant deployment to real-world commercial settings. Our proposed method won 4th place in the 2022 AI City Challenge, Track 4, with an F1 score of 0.4400 on experimental validation data.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

StandardSim: A Synthetic Dataset For Retail Environments

Stony Brook University（石溪大学）；Standard Cognition（标准认知）

Autonomous checkout systems rely on visual and sensory inputs to carry out fine-grained scene understanding in retail environments. Retail environments present unique challenges compared to typical indoor scenes owing to the vast number of densely packed, unique yet similar objects. The problem becomes even more difficult when only RGB input is available, especially for data-hungry tasks such as instance segmentation. To address the lack of datasets for retail, we present StandardSim, a large-scale photorealistic synthetic dataset featuring annotations for semantic segmentation, instance segme…

2022-02-04cs.CV

基于改进YOLOv10的增强型零售自助结账系统

Enhanced Self-Checkout System for Retail Based on Improved YOLOv10

Arizona State University（亚利桑那州立大学）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）；University of Minnesota（明尼苏达大学）；University of California, Irvine（加利福尼亚大学欧文分校）；Case Western Reserve University（凯斯西储大学）

本研究针对零售自助结账需求，通过引入YOLOv8检测头优化YOLOv10模型，并搭配场景专属后处理算法，构建的增强型自助结账系统在识别准确率和结账速度上均优于现有方法，为零售自动化提供了新方案。

2024-08-16cs.CV

ARC: A Vision-based Automatic Retail Checkout System

University of Engineering and Technology, Lahore (Main Campus)（拉合尔工程技术大学（主校区））

Retail checkout systems employed at supermarkets primarily rely on barcode scanners, with some utilizing QR codes, to identify the items being purchased. These methods are time-consuming in practice, require a certain level of human supervision, and involve waiting in long queues. In this regard, we propose a system, that we call ARC, which aims at making the process of check-out at retail store counters faster, autonomous, and more convenient, while reducing dependency on a human operator. The approach makes use of a computer vision-based system, with a Convolutional Neural Network at its cor…

2021-05-17cs.CV

Improving Domain Generalization by Learning without Forgetting: Application in Retail Checkout

CyberCore AI（赛博核心人工智能公司）

Designing an automatic checkout system for retail stores at the human level accuracy is challenging due to similar appearance products and their various poses. This paper addresses the problem by proposing a method with a two-stage pipeline. The first stage detects class-agnostic items, and the second one is dedicated to classify product categories. We also track the objects across video frames to avoid duplicated counting. One major challenge is the domain gap because the models are trained on synthetic data but tested on the real images. To reduce the error gap, we adopt domain generalizatio…

2022-07-12cs.CV

RPC: A Large-Scale Retail Product Checkout Dataset

Megvii Research Nanjing, Megvii Technology Ltd., Nanjing, China（南京旷视科技有限公司旷视研究院）；Graduate School of IPS, Waseda University, Fukuoka, Japan（早稻田大学国际政治经济学研究生院）；School of Computer Science, The University of Adelaide, Adelaide, Australia（阿德莱德大学计算机科学学院）

Over recent years, emerging interest has occurred in integrating computer vision technology into the retail industry. Automatic checkout (ACO) is one of the critical problems in this area which aims to automatically generate the shopping list from the images of the products to purchase. The main challenge of this problem comes from the large scale and the fine-grained nature of the product categories as well as the difficulty for collecting training images that reflect the realistic checkout scenarios due to continuous update of the products. Despite its significant practical and research valu…

2019-01-22cs.CV

使用Faster R-CNN和YOLO网络的协同训练半监督框架用于密集零售图像中的目标检测

A Co-Training Semi-Supervised Framework Using Faster R-CNN and YOLO Networks for Object Detection in Densely Packed Retail Images

Khazar University（哈扎尔大学）；Politecnico di Milano（米兰理工大学）；Duy Tan University（维新大学）

本研究提出一种半监督协同训练框架，结合Faster R-CNN与YOLO交换伪标签，并集成XGBoost等分类器与元启发式优化，有效提升了密集零售图像目标检测的精度与效率。

2025-09-11cs.AIcs.CV

更多相关论文收起更多论文

VISTA: Vision Transformer enhanced by U-Net and Image Colorfulness Frame Filtration for Automatic Retail Checkout

Giga Tech Ltd.（千兆科技有限公司）；Concordia University（康考迪亚大学）；North South University（北南大学）

Multi-class product counting and recognition identifies product items from images or videos for automated retail checkout. The task is challenging due to the real-world scenario of occlusions where product items overlap, fast movement in the conveyor belt, large similarity in overall appearance of the items being scanned, novel products, and the negative impact of misidentifying items. Further, there is a domain bias between training and test sets, specifically, the provided training dataset consists of synthetic images and the test set videos consist of foreign objects such as hands and tray.…

2022-04-23cs.CV

使用产品数字孪生进行 AutoRetail Checkout 训练

Training with Product Digital Twins for AutoRetail Checkout

NVIDIA（英伟达）

针对自动零售结账中真实标注数据稀缺及用户行为偏差问题，提出 DtTrain 框架，利用产品 3D 模型优化视角与光照生成数字孪生训练集，提升产品检测、跟踪与计数准确率。

2023-08-18cs.CV

An Improved Deep Learning Approach For Product Recognition on Racks in Retail Stores

Indian Institute of Technology (BHU)（印度理工学院（巴纳拉斯印度教大学））；Budge Budge Institute of Technology（巴奇巴奇理工学院）

Automated product recognition in retail stores is an important real-world application in the domain of Computer Vision and Pattern Recognition. In this paper, we consider the problem of automatically identifying the classes of the products placed on racks in retail stores from an image of the rack and information about the query/product images. We improve upon the existing approaches in terms of effectiveness and memory requirement by developing a two-stage object detection and recognition pipeline comprising of a Faster-RCNN-based object localizer that detects the object regions in the rack i…

2022-02-26cs.CV

ZeBROD：无需重新训练的识别和目标检测框架

ZeBROD: Zero-Retraining Based Recognition and Object Detection Framework

Politeknik Negeri Bandung（万隆国立理工学院）；Stunning Vision AI

ZeBROD通过整合YOLO11n和DeIT等技术，实现无需重新训练的目标检测与识别，提升训练效率和实际应用可行性。

2026-10-05cs.CV

Acquire, Augment, Segment & Enjoy: Weakly Supervised Instance Segmentation of Supermarket Products

MVTec Software GmbH（MVTec软件有限公司）；Technical University of Munich (TUM)（慕尼黑工业大学（TUM））

Grocery stores have thousands of products that are usually identified using barcodes with a human in the loop. For automated checkout systems, it is necessary to count and classify the groceries efficiently and robustly. One possibility is to use a deep learning algorithm for instance-aware semantic segmentation. Such methods achieve high accuracies but require a large amount of annotated training data. We propose a system to generate the training annotations in a weakly supervised manner, drastically reducing the labeling effort. We assume that for each training image, only the object class i…

2018-07-06cs.CV

RetailKLIP：在单GPU上使用度量学习微调OpenCLIP骨干网络以实现零样本零售产品图像分类

RetailKLIP : Finetuning OpenCLIP backbone using metric learning on a single GPU for Zero-shot retail product image classification

ParallelDots, Inc.（ParallelDots 公司）

本文提出RetailKLIP方法，通过度量学习在单GPU上微调OpenCLIP视觉编码器，使嵌入可直接用于最近邻分类，实现零样本零售产品图像分类，避免频繁重训练并节省资源。

2024-01-14cs.CV

Planogram Compliance Control via Object Detection, Sequence Alignment, and Focused Iterative Search

Migros（米格罗斯）

Smart retail stores are becoming the fact of our lives. Several computer vision and sensor based systems are working together to achieve such a complex and automated operation. Besides, the retail sector already has several open and challenging problems which can be solved with the help of pattern recognition and computer vision methods. One important problem to be tackled is the planogram compliance control. In this study, we propose a novel method to solve it. The proposed method is based on object detection, planogram compliance control, and focused and iterative search steps. The object de…

2022-12-02cs.CV

Bag of Tricks for Retail Product Image Classification

ParallelDots, Inc.（ParallelDots公司）

Retail Product Image Classification is an important Computer Vision and Machine Learning problem for building real world systems like self-checkout stores and automated retail execution evaluation. In this work, we present various tricks to increase accuracy of Deep Learning models on different types of retail product image classification datasets. These tricks enable us to increase the accuracy of fine tuned convnets for retail product image classification by a large margin. As the most prominent trick, we introduce a new neural network layer called Local-Concepts-Accumulation (LCA) layer whi…

2020-01-12cs.CVcs.LGstat.ML

RetailSMV：零售场景中基础视频世界模型的外视角与内视角适应

RetailSMV: Exocentric vs. Egocentric Adaptation of Foundation Video World Models in Retail

DreamVu

研究零售场景下基础视频世界模型的外视角与内视角适应，发现仅用外视角数据训练的模型在多项指标上优于或等同于联合训练。

2026-07-02cs.AIcs.CV

超市商品检测与识别：利用矫正图像的深度学习

Supermarket Product Detection and Recognition: Utilizing Deep Learning with Rectified Imagery

Indian Institute of Technology, Patna（印度理工学院巴特那分校）

针对超市货架密集图像因拍摄角度导致检测精度下降的问题，本文提出结合霍夫变换与单应性估计进行图像矫正，实验证明矫正能提升商品检测精度，但受角度和密度限制。

2026-10-07cs.AIcs.CV

面向自动化码垛任务的包装单元检测

Towards Packaging Unit Detection for Automated Palletizing Tasks

Fraunhofer Institute for Manufacturing Engineering and Automation IPA（弗劳恩霍夫制造工程与自动化研究所（IPA））

本文提出一种仅用合成数据训练的包装单元检测方法，可稳健处理稀疏低质传感器数据并泛化至多种零售产品与场景，且已通过真实数据评估、实验室集成及商业化验证。

2023-08-11cs.CVeess.IV

弥合目录与现实的差距：通过多阶段对比学习实现可扩展的产品识别

Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning

Walmart Global Tech（沃尔玛全球技术公司）

针对自动产品识别中现实与目录匹配的可扩展性瓶颈，提出将任务转为跨域检索问题，引入目录到现实多阶段对比学习范式，利用项目和图像级相似性微调视觉主干，能无缝扩展到未见产品和类别，有出色零样本泛化性能。

2026-07-14cs.CV