Time Series Anomaly Detection for Cyber-Physical Systems via Neural System Identification and Bayesian Filtering

Abstract

Recent advances in AIoT technologies have led to an increasing popularity of utilizing machine learning algorithms to detect operational failures for cyber-physical systems (CPS). In its basic form, an anomaly detection module monitors the sensor measurements and actuator states from the physical plant, and detects anomalies in these measurements to identify abnormal operation status. Nevertheless, building effective anomaly detection models for CPS is rather challenging as the model has to accurately detect anomalies in presence of highly complicated system dynamics and unknown amount of sensor noise. In this work, we propose a novel time series anomaly detection method called Neural System Identification and Bayesian Filtering (NSIBF) in which a specially crafted neural network architecture is posed for system identification, i.e., capturing the dynamics of CPS in a dynamical state-space model; then a Bayesian filtering algorithm is naturally applied on top of the "identified" state-space model for robust anomaly detection by tracking the uncertainty of the hidden state of the system recursively over time. We provide qualitative as well as quantitative experiments with the proposed method on a synthetic and three real-world CPS datasets, showing that NSIBF compares favorably to the state-of-the-art methods with considerable improvements on anomaly detection in CPS.

arXiv commentAppeared in KDD 2021

References in corpus (12)

• Adam: A Method for Stochastic Optimization
• TensorFlow: A system for large-scale machine learning
• Detecting Spacecraft Anomalies Using LSTMs and Nonparametric Dynamic Thresholding
• Deep Learning for Anomaly Detection: A Survey
• Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications
• A Recurrent Latent Variable Model for Sequential Data
• LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection
• Learning from Mutants: Using Code Mutation to Learn and Monitor Invariants of a Cyber-Physical System
• A Disentangled Recognition and Nonlinear Dynamics Model for Unsupervised Learning
• Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data
• Deep Learning-Based Anomaly Detection in Cyber-Physical Systems: Progress and Opportunities
• Interpretable, Multidimensional, Multimodal Anomaly Detection with Negative Sampling for Detection of Device Failure

Cited by in corpus (5)

• Deep Learning for Time Series Anomaly Detection: A Survey
• Multivariate Time-Series Anomaly Detection based on Enhancing Graph Attention Networks with Topological Analysis
• A Co-training Approach for Noisy Time Series Learning
• Time series anomaly detection with reconstruction-based state-space models
• MO-SAE:Multi-Objective Stacked Autoencoders Optimization for Edge Anomaly Detection