Deep Anomaly Detection for Time-series Data in Industrial IoT: A Communication-Efficient On-device Federated Learning Approach

Abstract

Since edge device failures (i.e., anomalies) seriously affect the production of industrial products in Industrial IoT (IIoT), accurately and timely detecting anomalies is becoming increasingly important. Furthermore, data collected by the edge device may contain the user's private data, which is challenging the current detection approaches as user privacy is calling for the public concern in recent years. With this focus, this paper proposes a new communication-efficient on-device federated learning (FL)-based deep anomaly detection framework for sensing time-series data in IIoT. Specifically, we first introduce a FL framework to enable decentralized edge devices to collaboratively train an anomaly detection model, which can improve its generalization ability. Second, we propose an Attention Mechanism-based Convolutional Neural Network-Long Short Term Memory (AMCNN-LSTM) model to accurately detect anomalies. The AMCNN-LSTM model uses attention mechanism-based CNN units to capture important fine-grained features, thereby preventing memory loss and gradient dispersion problems. Furthermore, this model retains the advantages of LSTM unit in predicting time series data. Third, to adapt the proposed framework to the timeliness of industrial anomaly detection, we propose a gradient compression mechanism based on Top-\textit{k} selection to improve communication efficiency. Extensive experiment studies on four real-world datasets demonstrate that the proposed framework can accurately and timely detect anomalies and also reduce the communication overhead by 50\% compared to the federated learning framework that does not use a gradient compression scheme.

arXiv commentIEEE Internet of Things Journal

References in corpus (3)

• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• Distributed Anomaly Detection using Autoencoder Neural Networks in WSN for IoT
• Dominant Dataset Selection Algorithms for Electricity Consumption Time-Series Data Analysis Based on Affine Transformation

Cited by in corpus (14)

• Detection of False Data Injection Attacks in Smart Grid: A Secure Federated Deep Learning Approach
• IoT Anomaly Detection Methods and Applications: A Survey
• Clustered Federated Learning Architecture for Network Anomaly Detection in Large Scale Heterogeneous IoT Networks
• Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection
• FedDPGAN: Federated Differentially Private Generative Adversarial Networks Framework for the Detection of COVID-19 Pneumonia
• A Federated Learning-based Industrial Health Prognostics for Heterogeneous Edge Devices using Matched Feature Extraction
• Federated Learning for 5G Base Station Traffic Forecasting
• Asynchronous Decentralized Federated Learning for Collaborative Fault Diagnosis of PV Stations
• Latent Diffusion Model-Enabled Low-Latency Semantic Communication in the Presence of Semantic Ambiguities and Wireless Channel Noises
• Precursor-of-Anomaly Detection for Irregular Time Series
• Spatio-Temporal Anomaly Detection with Graph Networks for Data Quality Monitoring of the Hadron Calorimeter
• Federated Learning for Tabular Data using TabNet: A Vehicular Use-Case
• Exploring and Enhancing Placement of IDS in RPL: A Federated Learning-based Approach
• Low-Rank Methods in Event Detection and Subsampled Point-to-Subspace Proximity Tests