Combating Interference for Over-the-Air Federated Learning: A Statistical Approach via RIS

Abstract

Over-the-air computation (AirComp) integrates analog communication with task-oriented computation, serving as a key enabling technique for communication-efficient federated learning (FL) over wireless networks. However, owing to its analog characteristics, AirComp-enabled FL (AirFL) is vulnerable to both unintentional and intentional interference. In this paper, we aim to attain robustness in AirComp aggregation against interference via reconfigurable intelligent surface (RIS) technology to artificially reconstruct wireless environments. Concretely, we establish performance objectives tailored for interference suppression in wireless FL systems, aiming to achieve unbiased gradient estimation and reduce its mean square error (MSE). Oriented at these objectives, we introduce the concept of phase-manipulated favorable propagation and channel hardening for AirFL, which relies on the adjustment of RIS phase shifts to realize statistical interference elimination and reduce the error variance of gradient estimation. Building upon this concept, we propose two robust aggregation schemes of power control and RIS phase shifts design, both ensuring unbiased gradient estimation in the presence of interference. Theoretical analysis of the MSE and FL convergence affirms the anti-interference capability of the proposed schemes. It is observed that computation and interference errors diminish by an order of $\mathcal{O}\left(\frac{1}{N}\right)$ where $N$ is the number of RIS elements, and the ideal convergence rate without interference can be asymptotically achieved by increasing $N$. Numerical results confirm the analytical results and validate the superior performance of the proposed schemes over existing baselines.

Accepted by IEEE Transactions on Signal Processing

References in corpus (17)

• Federated Learning: Challenges, Methods, and Future Directions
• An Overview of Signal Processing Techniques for RIS/IRS-aided Wireless Systems
• Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing
• Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
• UVeQFed: Universal Vector Quantization for Federated Learning
• Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks
• Over-the-Air Federated Learning from Heterogeneous Data
• On Analog Gradient Descent Learning over Multiple Access Fading Channels
• Intelligent Reflection Enabling Technologies for Integrated and Green Internet-of-Everything Beyond 5G: Communication, Sensing, and Security
• Interference Management for Over-the-Air Federated Learning in Multi-Cell Wireless Networks
• Adversary-resilient Distributed and Decentralized Statistical Inference and Machine Learning: An Overview of Recent Advances Under the Byzantine Threat Model
• On Secrecy Performance of RIS-Assisted MISO Systems over Rician Channels with Spatially Random Eavesdroppers
• Secure Outage Analysis of RIS-Assisted Communications with Discrete Phase Control
• Balancing Accuracy and Integrity for Reconfigurable Intelligent Surface-aided Over-the-Air Federated Learning
• BEV-SGD: Best Effort Voting SGD for Analog Aggregation Based Federated Learning against Byzantine Attackers
• Spectrum Breathing: Protecting Over-the-Air Federated Learning Against Interference
• Empowering Over-the-Air Personalized Federated Learning via RIS