Deep Learning for Anomaly Detection: A Survey

Abstract

Anomaly detection is an important problem that has been well-studied within diverse research areas and application domains. The aim of this survey is two-fold, firstly we present a structured and comprehensive overview of research methods in deep learning-based anomaly detection. Furthermore, we review the adoption of these methods for anomaly across various application domains and assess their effectiveness. We have grouped state-of-the-art research techniques into different categories based on the underlying assumptions and approach adopted. Within each category we outline the basic anomaly detection technique, along with its variants and present key assumptions, to differentiate between normal and anomalous behavior. For each category, we present we also present the advantages and limitations and discuss the computational complexity of the techniques in real application domains. Finally, we outline open issues in research and challenges faced while adopting these techniques.

References in corpus (29)

• Deep Learning in Neural Networks: An Overview
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Convolutional Neural Networks for Sentence Classification
• Zero-Shot Learning Through Cross-Modal Transfer
• Sum-Product Networks: A New Deep Architecture
• Deep and Confident Prediction for Time Series at Uber
• LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
• Anomaly Detection for a Water Treatment System Using Unsupervised Machine Learning
• DeepSign: Deep Learning for Automatic Malware Signature Generation and Classification
• Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks
• Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder
• Deep Learning for Time-Series Analysis
• Deep Learning for Unsupervised Insider Threat Detection in Structured Cybersecurity Data Streams
• Deep Learning and Its Applications to Machine Health Monitoring: A Survey
• Black-Box Attacks against RNN based Malware Detection Algorithms
• LSTM-Based System-Call Language Modeling and Robust Ensemble Method for Designing Host-Based Intrusion Detection Systems
• Multivariate Industrial Time Series with Cyber-Attack Simulation: Fault Detection Using an LSTM-based Predictive Data Model
• Improving the Accuracy of Pre-trained Word Embeddings for Sentiment Analysis
• Real-Time Illegal Parking Detection System Based on Deep Learning
• RNN-based Early Cyber-Attack Detection for the Tennessee Eastman Process
• Bidirectional LSTM-CRF for Clinical Concept Extraction
• Recurrent Neural Radio Anomaly Detection
• DOC: Deep Open Classification of Text Documents
• Modeling Representation of Videos for Anomaly Detection using Deep Learning: A Review
• Image denoising and restoration with CNN-LSTM Encoder Decoder with Direct Attention
• Solving the "false positives" problem in fraud prediction
• Recurrent Neural Networks for anomaly detection in the Post-Mortem time series of LHC superconducting magnets
• Generalized Zero-Shot Learning for Action Recognition with Web-Scale Video Data
• Deep Convolutional Neural Networks for Anomaly Event Classification on Distributed Systems

Cited by in corpus (5)

• Neural network-based anomaly detection for high-resolution X-ray spectroscopy
• Better the Devil you Know: An Analysis of Evasion Attacks using Out-of-Distribution Adversarial Examples
• Visual Analytics of Anomalous User Behaviors: A Survey
• Batch Uniformization for Minimizing Maximum Anomaly Score of DNN-based Anomaly Detection in Sounds
• Online Anomaly Detection with Sparse Gaussian Processes