Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding

Abstract

As spacecraft send back increasing amounts of telemetry data, improved anomaly detection systems are needed to lessen the monitoring burden placed on operations engineers and reduce operational risk. Current spacecraft monitoring systems only target a subset of anomaly types and often require costly expert knowledge to develop and maintain due to challenges involving scale and complexity. We demonstrate the effectiveness of Long Short-Term Memory (LSTMs) networks, a type of Recurrent Neural Network (RNN), in overcoming these issues using expert-labeled telemetry anomaly data from the Soil Moisture Active Passive (SMAP) satellite and the Mars Science Laboratory (MSL) rover, Curiosity. We also propose a complementary unsupervised and nonparametric anomaly thresholding approach developed during a pilot implementation of an anomaly detection system for SMAP, and offer false positive mitigation strategies along with other key improvements and lessons learned during development.

arXiv commentKDD 2018 camera-ready version

References in corpus (2)

• Deep Learning in Neural Networks: An Overview
• Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmark

Cited by in corpus (56)

• A Unifying Review of Deep and Shallow Anomaly Detection
• Deep Learning for Time Series Anomaly Detection: A Survey
• DCdetector: Dual Attention Contrastive Representation Learning for Time Series Anomaly Detection
• MST-GAT: A Multimodal Spatial-Temporal Graph Attention Network for Time Series Anomaly Detection
• An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series
• Current Time Series Anomaly Detection Benchmarks are Flawed and are Creating the Illusion of Progress
• TFAD: A Decomposition Time Series Anomaly Detection Architecture with Time-Frequency Analysis
• DTAAD: Dual Tcn-Attention Networks for Anomaly Detection in Multivariate Time Series Data
• Correlation-aware Spatial-Temporal Graph Learning for Multivariate Time-series Anomaly Detection
• Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filtering
• Local Evaluation of Time Series Anomaly Detection Algorithms
• Unsupervised Anomaly Detection in Time-series: An Extensive Evaluation and Analysis of State-of-the-art Methods
• Unsupervised Deep Learning for IoT Time Series
• Unsupervised Time Series Outlier Detection with Diversity-Driven Convolutional Ensembles -- Extended Version
• Is it worth it? Comparing six deep and classical methods for unsupervised anomaly detection in time series
• Adaptive Performance Anomaly Detection for Online Service Systems via Pattern Sketching
• Explainable Time Series Anomaly Detection using Masked Latent Generative Modeling
• Anomaly Detection in a Large-scale Cloud Platform
• Multivariate Time-Series Anomaly Detection based on Enhancing Graph Attention Networks with Topological Analysis
• The Machine Learning Bazaar: Harnessing the ML Ecosystem for Effective System Development
• DACAD: Domain Adaptation Contrastive Learning for Anomaly Detection in Multivariate Time Series
• An Anomaly Detection Method for Satellites Using Monte Carlo Dropout
• Self-Supervised Learning of Time Series Representation via Diffusion Process and Imputation-Interpolation-Forecasting Mask
• Precursor-of-Anomaly Detection for Irregular Time Series
• Learning Graph Structures with Transformer for Multivariate Time Series Anomaly Detection in IoT
• A Comparison of Deep Learning Architectures for Spacecraft Anomaly Detection
• MAD: Self-Supervised Masked Anomaly Detection Task for Multivariate Time Series
• Sintel: A Machine Learning Framework to Extract Insights from Signals
• Efficient IoT Devices Localization Through Wi-Fi CSI Feature Fusion and Anomaly Detection
• A Shapelet-based Framework for Unsupervised Multivariate Time Series Representation Learning
• Anomaly Detection in Cloud Components
• Detecting Anomalies within Smart Buildings using Do-It-Yourself Internet of Things
• Anomaly Detection in Large-Scale Cloud Systems: An Industry Case and Dataset
• Anomaly Detection for Multivariate Time Series on Large-scale Fluid Handling Plant Using Two-stage Autoencoder
• AlerTiger: Deep Learning for AI Model Health Monitoring at LinkedIn
• Regional-Local Adversarially Learned One-Class Classifier Anomalous Sound Detection in Global Long-Term Space
• Entropy Causal Graphs for Multivariate Time Series Anomaly Detection
• PAC-Wrap: Semi-Supervised PAC Anomaly Detection
• Hypergraph Learning based Recommender System for Anomaly Detection, Control and Optimization
• Towards an Awareness of Time Series Anomaly Detection Models' Adversarial Vulnerability
• Diagnostic Spatio-temporal Transformer with Faithful Encoding
• A Review on Self-Supervised Learning for Time Series Anomaly Detection: Recent Advances and Open Challenges
• Hierarchical knowledge guided fault intensity diagnosis of complex industrial systems
• Noise-Resilient Point-wise Anomaly Detection in Time Series Using Weak Segment Labels
• xLSTMAD: A Powerful xLSTM-based Method for Anomaly Detection
• TriP-LLM: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detection
• Robust Group Anomaly Detection for Quasi-Periodic Network Time Series
• LSTM-Based Anomaly Detection: Detection Rules from Extreme Value Theory
• Predictive maintenance solution for industrial systems -- an unsupervised approach based on log periodic power law
• TeVAE: A Variational Autoencoder Approach for Discrete Online Anomaly Detection in Variable-state Multivariate Time-series Data
• DINAMO: Dynamic and INterpretable Anomaly MOnitoring for Large-Scale Particle Physics Experiments
• VBridge: Connecting the Dots Between Features and Data to Explain Healthcare Models
• PATH: A Discrete-sequence Dataset for Evaluating Online Unsupervised Anomaly Detection Approaches for Multivariate Time Series
• Benchmarking Deep Learning Models for Anomaly Detection in Real-World Cloud Telemetry
• A Hierarchical Ensemble Pipeline for Anomaly Detection in ESA Satellite Telemetry
• MO-SAE:Multi-Objective Stacked Autoencoders Optimization for Edge Anomaly Detection