Communication Efficiency in Federated Learning: Achievements and Challenges

Abstract

Federated Learning (FL) is known to perform Machine Learning tasks in a distributed manner. Over the years, this has become an emerging technology especially with various data protection and privacy policies being imposed FL allows performing machine learning tasks whilst adhering to these challenges. As with the emerging of any new technology, there are going to be challenges and benefits. A challenge that exists in FL is the communication costs, as FL takes place in a distributed environment where devices connected over the network have to constantly share their updates this can create a communication bottleneck. In this paper, we present a survey of the research that is performed to overcome the communication constraints in an FL setting.

References in corpus (28)

• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Federated Learning: Strategies for Improving Communication Efficiency
• Federated Learning with Non-IID Data
• A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
• Federated Learning for Mobile Keyboard Prediction
• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation
• Applied Federated Learning: Improving Google Keyboard Query Suggestions
• Federated Optimization in Heterogeneous Networks
• Communication Efficient Distributed Optimization using an Approximate Newton-type Method
• HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning
• UVeQFed: Universal Vector Quantization for Federated Learning
• Threats to Federated Learning: A Survey
• BrainTorrent: A Peer-to-Peer Environment for Decentralized Federated Learning
• Communication Compression for Decentralized Training
• One-Shot Federated Learning
• Peer-to-peer Federated Learning on Graphs
• Federated Multi-Task Learning
• AIDE: Fast and Communication Efficient Distributed Optimization
• Federated Learning Of Out-Of-Vocabulary Words
• Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies
• Central Server Free Federated Learning over Single-sided Trust Social Networks
• Privacy-Preserving Blockchain-Based Federated Learning for IoT Devices
• Federated Learning With Quantized Global Model Updates
• Hyper-Sphere Quantization: Communication-Efficient SGD for Federated Learning
• Decentralized Deep Learning with Arbitrary Communication Compression
• Partitioned Variational Inference: A unified framework encompassing federated and continual learning
• Robust and Communication-Efficient Collaborative Learning

Cited by in corpus (4)

• A review of federated learning in renewable energy applications: Potential, challenges, and future directions
• Adaptive Client Selection with Personalization for Communication Efficient Federated Learning
• Federated Learning Across Decentralized and Unshared Archives for Remote Sensing Image Classification
• Learning to Transmit with Provable Guarantees in Wireless Federated Learning