RPC: A Large-Scale Retail Product Checkout Dataset

Abstract

Over recent years, emerging interest has occurred in integrating computer vision technology into the retail industry. Automatic checkout (ACO) is one of the critical problems in this area which aims to automatically generate the shopping list from the images of the products to purchase. The main challenge of this problem comes from the large scale and the fine-grained nature of the product categories as well as the difficulty for collecting training images that reflect the realistic checkout scenarios due to continuous update of the products. Despite its significant practical and research value, this problem is not extensively studied in the computer vision community, largely due to the lack of a high-quality dataset. To fill this gap, in this work we propose a new dataset to facilitate relevant research. Our dataset enjoys the following characteristics: (1) It is by far the largest dataset in terms of both product image quantity and product categories. (2) It includes single-product images taken in a controlled environment and multi-product images taken by the checkout system. (3) It provides different levels of annotations for the check-out images. Comparing with the existing datasets, ours is closer to the realistic setting and can derive a variety of research problems. Besides the dataset, we also benchmark the performance on this dataset with various approaches. The dataset and related resources can be found at \url{https://rpc-dataset.github.io/}.

arXiv commentProject page: https://rpc-dataset.github.io/

References in corpus (4)

• Auto-Encoding Variational Bayes
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• The Freiburg Groceries Dataset
• Improving Object Counting with Heatmap Regulation

Cited by in corpus (15)

• BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognition
• Deep Learning for Fine-Grained Image Analysis: A Survey
• Parameter-Efficient Person Re-identification in the 3D Space
• Multi-Label Image Recognition with Graph Convolutional Networks
• Boosting-GNN: Boosting Algorithm for Graph Networks on Imbalanced Node Classification
• Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrieval
• RP2K: A Large-Scale Retail Product Dataset for Fine-Grained Image Classification
• Dual Attention Suppression Attack: Generate Adversarial Camouflage in Physical World
• Bias-based Universal Adversarial Patch Attack for Automatic Check-out
• Fine-Grained Image Analysis with Deep Learning: A Survey
• Data Priming Network for Automatic Check-Out
• Product Image Recognition with Guidance Learning and Noisy Supervision
• Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretraining
• MessyTable: Instance Association in Multiple Camera Views
• SpotPatch: Parameter-Efficient Transfer Learning for Mobile Object Detection