LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection

Abstract

Mechanical devices such as engines, vehicles, aircrafts, etc., are typically instrumented with numerous sensors to capture the behavior and health of the machine. However, there are often external factors or variables which are not captured by sensors leading to time-series which are inherently unpredictable. For instance, manual controls and/or unmonitored environmental conditions or load may lead to inherently unpredictable time-series. Detecting anomalies in such scenarios becomes challenging using standard approaches based on mathematical models that rely on stationarity, or prediction models that utilize prediction errors to detect anomalies. We propose a Long Short Term Memory Networks based Encoder-Decoder scheme for Anomaly Detection (EncDec-AD) that learns to reconstruct 'normal' time-series behavior, and thereafter uses reconstruction error to detect anomalies. We experiment with three publicly available quasi predictable time-series datasets: power demand, space shuttle, and ECG, and two real-world engine datasets with both predictive and unpredictable behavior. We show that EncDec-AD is robust and can detect anomalies from predictable, unpredictable, periodic, aperiodic, and quasi-periodic time-series. Further, we show that EncDec-AD is able to detect anomalies from short time-series (length as small as 30) as well as long time-series (length as large as 500).

Accepted at ICML 2016 Anomaly Detection Workshop, New York, NY, USA, 2016. Reference update in this version (v2)

References in corpus (1)

• A Hierarchical Neural Autoencoder for Paragraphs and Documents

Cited by in corpus (19)

• Deep Learning for Anomaly Detection: A Survey
• Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder
• TimeNet: Pre-trained deep recurrent neural network for time series classification
• RNN-based Early Cyber-Attack Detection for the Tennessee Eastman Process
• Multivariate Time-series Anomaly Detection via Graph Attention Network
• ADIC: Anomaly Detection Integrated Circuit in 65nm CMOS utilizing Approximate Computing
• RSM-GAN: A Convolutional Recurrent GAN for Anomaly Detection in Contaminated Seasonal Multivariate Time Series
• Improving Robustness on Seasonality-Heavy Multivariate Time Series Anomaly Detection
• Anomaly Detection on Seasonal Metrics via Robust Time Series Decomposition
• PyODDS: An End-to-End Outlier Detection System
• TimeAutoML: Autonomous Representation Learning for Multivariate Irregularly Sampled Time Series
• Dimensionality Increment of PMU Data for Anomaly Detection in Low Observability Power Systems
• An Adaptive Approach for Anomaly Detector Selection and Fine-Tuning in Time Series
• Visual Analytics of Anomalous User Behaviors: A Survey
• Learning Competitive and Discriminative Reconstructions for Anomaly Detection
• ShortFuse: Biomedical Time Series Representations in the Presence of Structured Information
• Multi-Scale One-Class Recurrent Neural Networks for Discrete Event Sequence Anomaly Detection
• Self-Supervised Encoder for Fault Prediction in Electrochemical Cells
• Sequential Anomaly Detection using Inverse Reinforcement Learning