Manifolds for Unsupervised Visual Anomaly Detection
arXiv:2006.11364
Abstract
Anomalies are by definition rare, thus labeled examples are very limited or nonexistent, and likely do not cover unforeseen scenarios. Unsupervised learning methods that don't necessarily encounter anomalies in training would be immensely useful. Generative vision models can be useful in this regard but do not sufficiently represent normal and abnormal data distributions. To this end, we propose constant curvature manifolds for embedding data distributions in unsupervised visual anomaly detection. Through theoretical and empirical explorations of manifold shapes, we develop a novel hyperspherical Variational Auto-Encoder (VAE) via stereographic projections with a gyroplane layer - a complete equivalent to the Poincaré VAE. This approach with manifold projections is beneficial in terms of model generalization and can yield more interpretable representations. We present state-of-the-art results on visual anomaly benchmarks in precision manufacturing and inspection, demonstrating real-world utility in industrial AI scenarios. We further demonstrate the approach on the challenging problem of histopathology: our unsupervised approach effectively detects cancerous brain tissue from noisy whole-slide images, learning a smooth, latent organization of tissue types that provides an interpretable decisions tool for medical professionals.
References in corpus (12)
- Auto-Encoding Variational Bayes
- Neural Discrete Representation Learning
- Generative Probabilistic Novelty Detection with Adversarial Autoencoders
- A Survey on GANs for Anomaly Detection
- Explorations in Homeomorphic Variational Auto-Encoding
- VAE with a VampPrior
- Continuous Hierarchical Representations with Poincaré Variational Auto-Encoders
- Geoopt: Riemannian Optimization in PyTorch
- Hyperbolic Neural Networks
- Adversarial Autoencoders with Constant-Curvature Latent Manifolds
- Only Bayes should learn a manifold (on the estimation of differential geometric structure from data)
- Fine-Grain Few-Shot Vision via Domain Knowledge as Hyperspherical Priors