Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach
arXiv:2011.10282
Abstract
To exploit massive amounts of data generated at mobile edge networks, federated learning (FL) has been proposed as an attractive substitute for centralized machine learning (ML). By collaboratively training a shared learning model at edge devices, FL avoids direct data transmission and thus overcomes high communication latency and privacy issues as compared to centralized ML. To improve the communication efficiency in FL model aggregation, over-the-air computation has been introduced to support a large number of simultaneous local model uploading by exploiting the inherent superposition property of wireless channels. However, due to the heterogeneity of communication capacities among edge devices, over-the-air FL suffers from the straggler issue in which the device with the weakest channel acts as a bottleneck of the model aggregation performance. This issue can be alleviated by device selection to some extent, but the latter still suffers from a tradeoff between data exploitation and model communication. In this paper, we leverage the reconfigurable intelligent surface (RIS) technology to relieve the straggler issue in over-the-air FL. Specifically, we develop a learning analysis framework to quantitatively characterize the impact of device selection and model aggregation error on the convergence of over-the-air FL. Then, we formulate a unified communication-learning optimization problem to jointly optimize device selection, over-the-air transceiver design, and RIS configuration. Numerical experiments show that the proposed design achieves substantial learning accuracy improvement compared with the state-of-the-art approaches, especially when channel conditions vary dramatically across edge devices.
arXiv commentSimulation codes are available at https://github.com/liuhang1994/RIS-FL. This work has been accepted by IEEE Transactions on Wireless Communications
References in corpus (11)
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Wireless Communications with Reconfigurable Intelligent Surface: Path Loss Modeling and Experimental Measurement
- Federated Optimization: Distributed Machine Learning for On-Device Intelligence
- Recent Trends in Deep Learning Based Natural Language Processing
- Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
- Intelligent Reflecting Surface Aided Multigroup Multicast MISO Communication Systems
- Decomposition by Partial Linearization: Parallel Optimization of Multi-Agent Systems
- Intelligent Reflecting Surface Aided MIMO Broadcasting for Simultaneous Wireless Information and Power Transfer
- Reconfigurable-Intelligent-Surface Empowered Wireless Communications: Challenges and Opportunities
- Beamforming Optimization for Wireless Network Aided by Intelligent Reflecting Surface with Discrete Phase Shifts
Cited by in corpus (3)
- Interplay between RIS and AI in Wireless Communications: Fundamentals, Architectures, Applications, and Open Research Problems
- Temporal-Structure-Assisted Gradient Aggregation for Over-the-Air Federated Edge Learning
- Delay Analysis of Wireless Federated Learning Based on Saddle Point Approximation and Large Deviation Theory