Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications
arXiv:2012.01489
Abstract
Distributed machine learning (DML) techniques, such as federated learning, partitioned learning, and distributed reinforcement learning, have been increasingly applied to wireless communications. This is due to improved capabilities of terminal devices, explosively growing data volume, congestion in the radio interfaces, and increasing concern of data privacy. The unique features of wireless systems, such as large scale, geographically dispersed deployment, user mobility, and massive amount of data, give rise to new challenges in the design of DML techniques. There is a clear gap in the existing literature in that the DML techniques are yet to be systematically reviewed for their applicability to wireless systems. This survey bridges the gap by providing a contemporary and comprehensive survey of DML techniques with a focus on wireless networks. Specifically, we review the latest applications of DML in power control, spectrum management, user association, and edge cloud computing. The optimality, scalability, convergence rate, computation cost, and communication overhead of DML are analyzed. We also discuss the potential adversarial attacks faced by DML applications, and describe state-of-the-art countermeasures to preserve privacy and security. Last but not least, we point out a number of key issues yet to be addressed, and collate potentially interesting and challenging topics for future research.
References in corpus (40)
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Playing Atari with Deep Reinforcement Learning
- Federated Learning: Strategies for Improving Communication Efficiency
- Federated Optimization: Distributed Machine Learning for On-Device Intelligence
- In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
- QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
- Speeding Up Distributed Machine Learning Using Codes
- Secure Federated Transfer Learning
- Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air
- Federated Optimization:Distributed Optimization Beyond the Datacenter
- Optimal Distributed Online Prediction using Mini-Batches
- Differentially Private Federated Learning: A Client Level Perspective
- Large Batch Training of Convolutional Networks
- Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
- Towards Massive Machine Type Communications in Ultra-Dense Cellular IoT Networks: Current Issues and Machine Learning-Assisted Solutions
- Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks
- On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization
- Stochastic Gradient Push for Distributed Deep Learning
- Distributed Compressive Sensing: A Deep Learning Approach
- High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning
- Preconditioned Stochastic Gradient Descent
- Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator
- A Survey on Applications of Model-Free Strategy Learning in Cognitive Wireless Networks
- Distilled One-Shot Federated Learning
- Multi-Participant Multi-Class Vertical Federated Learning
- A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression
- A Game-Theoretic Approach to Design Secure and Resilient Distributed Support Vector Machines
- FOCUS: Dealing with Label Quality Disparity in Federated Learning
- Energy-Efficient Radio Resource Allocation for Federated Edge Learning
- Asymmetrical Vertical Federated Learning
- Iterative MapReduce for Large Scale Machine Learning
- Toward Understanding the Impact of Staleness in Distributed Machine Learning
- On Safeguarding Privacy and Security in the Framework of Federated Learning
- Gradient Statistics Aware Power Control for Over-the-Air Federated Learning
- Stochastic Nonconvex Optimization with Large Minibatches
- Joint Service Pricing and Cooperative Relay Communication for Federated Learning
- A DAG Model of Synchronous Stochastic Gradient Descent in Distributed Deep Learning
- Coded Federated Computing in Wireless Networks with Straggling Devices and Imperfect CSI
- Security of Distributed Machine Learning: A Game-Theoretic Approach to Design Secure DSVM
- Shot in the Dark: Few-Shot Learning with No Base-Class Labels