CutPaste: Self-Supervised Learning for Anomaly Detection and Localization

Abstract

We aim at constructing a high performance model for defect detection that detects unknown anomalous patterns of an image without anomalous data. To this end, we propose a two-stage framework for building anomaly detectors using normal training data only. We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations. We learn representations by classifying normal data from the CutPaste, a simple data augmentation strategy that cuts an image patch and pastes at a random location of a large image. Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects. We bring the improvement upon previous arts by 3.1 AUCs when learning representations from scratch. By transfer learning on pretrained representations on ImageNet, we achieve a new state-of-theart 96.6 AUC. Lastly, we extend the framework to learn and extract representations from patches to allow localizing defective areas without annotations during training.

arXiv commentPublished at CVPR 2021. The first two authors contributed equally

Cited by in corpus (8)

• Generalized Out-of-Distribution Detection: A Survey
• FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flows
• Student-Teacher Feature Pyramid Matching for Anomaly Detection
• Precursor-of-Anomaly Detection for Irregular Time Series
• A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challenges
• Contrastive Predictive Coding for Anomaly Detection
• Identifying the Defective: Detecting Damaged Grains for Cereal Appearance Inspection
• Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization