Student-Teacher Feature Pyramid Matching for Anomaly Detection

Abstract

Anomaly detection is a challenging task and usually formulated as an one-class learning problem for the unexpectedness of anomalies. This paper proposes a simple yet powerful approach to this issue, which is implemented in the student-teacher framework for its advantages but substantially extends it in terms of both accuracy and efficiency. Given a strong model pre-trained on image classification as the teacher, we distill the knowledge into a single student network with the identical architecture to learn the distribution of anomaly-free images and this one-step transfer preserves the crucial clues as much as possible. Moreover, we integrate the multi-scale feature matching strategy into the framework, and this hierarchical feature matching enables the student network to receive a mixture of multi-level knowledge from the feature pyramid under better supervision, thus allowing to detect anomalies of various sizes. The difference between feature pyramids generated by the two networks serves as a scoring function indicating the probability of anomaly occurring. Due to such operations, our approach achieves accurate and fast pixel-level anomaly detection. Very competitive results are delivered on the MVTec anomaly detection dataset, superior to the state of the art ones.

arXiv commentAccepted by BMVC'2021

References in corpus (11)

• Wide Residual Networks
• Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddings
• Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoders
• Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images
• Deep Anomaly Detection Using Geometric Transformations
• Sub-Image Anomaly Detection with Deep Pyramid Correspondences
• Anomaly Detection using One-Class Neural Networks
• CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
• Metric Learning for Novelty and Anomaly Detection
• Attribute Restoration Framework for Anomaly Detection
• Identifying and Categorizing Anomalies in Retinal Imaging Data

Cited by in corpus (6)

• Deep Industrial Image Anomaly Detection: A Survey
• Collaborative Discrepancy Optimization for Reliable Image Anomaly Localization
• Unsupervised Pathology Detection: A Deep Dive Into the State of the Art
• Learning image representations for anomaly detection: application to discovery of histological alterations in drug development
• Distillation-based fabric anomaly detection
• Unsupervised Learning for Industrial Defect Detection: A Case Study on Shearographic Data