Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks

Abstract

Automating the detection of anomalous events within long video sequences is challenging due to the ambiguity of how such events are defined. We approach the problem by learning generative models that can identify anomalies in videos using limited supervision. We propose end-to-end trainable composite Convolutional Long Short-Term Memory (Conv-LSTM) networks that are able to predict the evolution of a video sequence from a small number of input frames. Regularity scores are derived from the reconstruction errors of a set of predictions with abnormal video sequences yielding lower regularity scores as they diverge further from the actual sequence over time. The models utilize a composite structure and examine the effects of conditioning in learning more meaningful representations. The best model is chosen based on the reconstruction and prediction accuracy. The Conv-LSTM models are evaluated both qualitatively and quantitatively, demonstrating competitive results on anomaly detection datasets. Conv-LSTM units are shown to be an effective tool for modeling and predicting video sequences.

References in corpus (3)

• Adam: A Method for Stochastic Optimization
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Spatio-temporal video autoencoder with differentiable memory

Cited by in corpus (21)

• Deep Learning for Anomaly Detection: A Survey
• Anomaly Detection in Road Traffic Using Visual Surveillance: A Survey
• Future Frame Prediction for Anomaly Detection -- A New Baseline
• Anomaly Detection in Aerial Videos with Transformers
• Learning Memory-guided Normality for Anomaly Detection
• When, Where, and What? A New Dataset for Anomaly Detection in Driving Videos
• Anomaly Locality in Video Surveillance
• Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals
• Foundation Models and Transformers for Anomaly Detection: A Survey
• Inception-inspired LSTM for Next-frame Video Prediction
• Future Frame Prediction Using Convolutional VRNN for Anomaly Detection
• VizADS-B: Analyzing Sequences of ADS-B Images Using Explainable Convolutional LSTM Encoder-Decoder to Detect Cyber Attacks
• Anomaly Detection using Deep Reconstruction and Forecasting for Autonomous Systems
• An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing
• Good Practices and A Strong Baseline for Traffic Anomaly Detection
• Detection of Unknown Anomalies in Streaming Videos with Generative Energy-based Boltzmann Models
• Attentioned Convolutional LSTM InpaintingNetwork for Anomaly Detection in Videos
• Few-shot Scene-adaptive Anomaly Detection
• EvAn: Neuromorphic Event-based Anomaly Detection
• Convolutional Recurrent Reconstructive Network for Spatiotemporal Anomaly Detection in Solder Paste Inspection
• A Promotion Method for Generation Error Based Video Anomaly Detection