Unsupervised Anomaly Detection From Semantic Similarity Scores
arXiv:2012.00461
Abstract
Classifying samples as in-distribution or out-of-distribution (OOD) is a challenging problem of anomaly detection and a strong test of the generalisation power for models of the in-distribution. In this paper, we present a simple and generic framework, {\it SemSAD}, that makes use of a semantic similarity score to carry out anomaly detection. The idea is to first find for any test example the semantically closest examples in the training set, where the semantic relation between examples is quantified by the cosine similarity between feature vectors that leave semantics unchanged under transformations, such as geometric transformations (images), time shifts (audio signals), and synonymous word substitutions (text). A trained discriminator is then used to classify a test example as OOD if the semantic similarity to its nearest neighbours is significantly lower than the corresponding similarity for test examples from the in-distribution. We are able to outperform previous approaches for anomaly, novelty, or out-of-distribution detection in the visual domain by a large margin. In particular, we obtain AUROC values close to one for the challenging task of detecting examples from CIFAR-10 as out-of-distribution given CIFAR-100 as in-distribution, without making use of label information.
arXiv commentThe reported AUROC values are wrong due to an implementation error. In short, there was information leakage by Batch Normalisation during training the discriminator
References in corpus (11)
- Auto-Encoding Variational Bayes
- A Simple Framework for Contrastive Learning of Visual Representations
- A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks
- A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks
- Deep Anomaly Detection Using Geometric Transformations
- Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encoder
- Metric Learning for Novelty and Anomaly Detection
- Contrastive Training for Improved Out-of-Distribution Detection
- Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Features
- Towards neural networks that provably know when they don't know
- Hybrid Models for Open Set Recognition