Video Anomaly Detection and Localization via Gaussian Mixture Fully Convolutional Variational Autoencoder
arXiv:1805.11223
Abstract
We present a novel end-to-end partially supervised deep learning approach for video anomaly detection and localization using only normal samples. The insight that motivates this study is that the normal samples can be associated with at least one Gaussian component of a Gaussian Mixture Model (GMM), while anomalies either do not belong to any Gaussian component. The method is based on Gaussian Mixture Variational Autoencoder, which can learn feature representations of the normal samples as a Gaussian Mixture Model trained using deep learning. A Fully Convolutional Network (FCN) that does not contain a fully-connected layer is employed for the encoder-decoder structure to preserve relative spatial coordinates between the input image and the output feature map. Based on the joint probabilities of each of the Gaussian mixture components, we introduce a sample energy based method to score the anomaly of image test patches. A two-stream network framework is employed to combine the appearance and motion anomalies, using RGB frames for the former and dynamic flow images, for the latter. We test our approach on two popular benchmarks (UCSD Dataset and Avenue Dataset). The experimental results verify the superiority of our method compared to the state of the arts.
References in corpus (6)
- Adam: A Method for Stochastic Optimization
- Auto-Encoding Variational Bayes
- Two-Stream Convolutional Networks for Action Recognition in Videos
- Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders
- A Discriminative Framework for Anomaly Detection in Large Videos
- Actions ~ Transformations
Cited by in corpus (4)
- Detecting Respiratory Pathologies Using Convolutional Neural Networks and Variational Autoencoders for Unbalancing Data
- Anomaly Detection based on Zero-Shot Outlier Synthesis and Hierarchical Feature Distillation
- A Promotion Method for Generation Error Based Video Anomaly Detection
- Distorted Representation Space Characterization Through Backpropagated Gradients