Federated PCA on Grassmann Manifold for IoT Anomaly Detection

Abstract

With the proliferation of the Internet of Things (IoT) and the rising interconnectedness of devices, network security faces significant challenges, especially from anomalous activities. While traditional machine learning-based intrusion detection systems (ML-IDS) effectively employ supervised learning methods, they possess limitations such as the requirement for labeled data and challenges with high dimensionality. Recent unsupervised ML-IDS approaches such as AutoEncoders and Generative Adversarial Networks (GAN) offer alternative solutions but pose challenges in deployment onto resource-constrained IoT devices and in interpretability. To address these concerns, this paper proposes a novel federated unsupervised anomaly detection framework, FedPCA, that leverages Principal Component Analysis (PCA) and the Alternating Directions Method Multipliers (ADMM) to learn common representations of distributed non-i.i.d. datasets. Building on the FedPCA framework, we propose two algorithms, FEDPE in Euclidean space and FEDPG on Grassmann manifolds. Our approach enables real-time threat detection and mitigation at the device level, enhancing network resilience while ensuring privacy. Moreover, the proposed algorithms are accompanied by theoretical convergence rates even under a subsampling scheme, a novel result. Experimental results on the UNSW-NB15 and TON-IoT datasets show that our proposed methods offer performance in anomaly detection comparable to nonlinear baselines, while providing significant improvements in communication and memory efficiency, underscoring their potential for securing IoT networks.

arXiv commentAccepted for publication at IEEE/ACM Transactions on Networking

References in corpus (15)

• Federated Learning: Strategies for Improving Communication Efficiency
• Federated Learning with Non-IID Data
• Federated Learning for Internet of Things: A Comprehensive Survey
• N-BaIoT: Network-based Detection of IoT Botnet Attacks Using Deep Autoencoders
• On the Convergence of FedAvg on Non-IID Data
• A Unifying Review of Deep and Shallow Anomaly Detection
• Federated Optimization:Distributed Optimization Beyond the Datacenter
• Efficient GAN-Based Anomaly Detection
• Asynchronous Distributed ADMM for Large-Scale Optimization- Part II: Linear Convergence Analysis and Numerical Performance
• Inexact-ADMM Based Federated Meta-Learning for Fast and Continual Edge Learning
• Grassmannian Learning: Embedding Geometry Awareness in Shallow and Deep Learning
• Federated Principal Component Analysis
• Distributed Convex Optimization with Many Convex Constraints
• Communication-Efficient ADMM-based Federated Learning
• Accelerated Algorithms for Convex and Non-Convex Optimization on Manifolds