Federated Learning in Mobile Edge Networks: A Comprehensive Survey

Abstract

In recent years, mobile devices are equipped with increasingly advanced sensing and computing capabilities. Coupled with advancements in Deep Learning (DL), this opens up countless possibilities for meaningful applications. Traditional cloudbased Machine Learning (ML) approaches require the data to be centralized in a cloud server or data center. However, this results in critical issues related to unacceptable latency and communication inefficiency. To this end, Mobile Edge Computing (MEC) has been proposed to bring intelligence closer to the edge, where data is produced. However, conventional enabling technologies for ML at mobile edge networks still require personal data to be shared with external parties, e.g., edge servers. Recently, in light of increasingly stringent data privacy legislations and growing privacy concerns, the concept of Federated Learning (FL) has been introduced. In FL, end devices use their local data to train an ML model required by the server. The end devices then send the model updates rather than raw data to the server for aggregation. FL can serve as an enabling technology in mobile edge networks since it enables the collaborative training of an ML model and also enables DL for mobile edge network optimization. However, in a large-scale and complex mobile edge network, heterogeneous devices with varying constraints are involved. This raises challenges of communication costs, resource allocation, and privacy and security in the implementation of FL at scale. In this survey, we begin with an introduction to the background and fundamentals of FL. Then, we highlight the aforementioned challenges of FL implementation and review existing solutions. Furthermore, we present the applications of FL for mobile edge network optimization. Finally, we discuss the important challenges and future research directions in FL

References in corpus (61)

• Deep Learning in Neural Networks: An Overview
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Deep Learning with Differential Privacy
• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Playing Atari with Deep Reinforcement Learning
• A Brief Survey of Deep Reinforcement Learning
• Federated Learning: Strategies for Improving Communication Efficiency
• Learning Transferable Features with Deep Adaptation Networks
• Deep Learning for Sensor-based Activity Recognition: A Survey
• Federated Learning with Non-IID Data
• Federated Optimization: Distributed Machine Learning for On-Device Intelligence
• Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
• Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
• Federated Learning for Mobile Keyboard Prediction
• In-Edge AI: Intelligentizing Mobile Edge Computing, Caching and Communication by Federated Learning
• Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
• Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training
• On the Convergence of FedAvg on Non-IID Data
• A Survey on Mobile Edge Networks: Convergence of Computing, Caching and Communications
• Towards Federated Learning at Scale: System Design
• How To Backdoor Federated Learning
• Learning Differentially Private Recurrent Language Models
• Revisiting Distributed Synchronous SGD
• On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima
• Federated Learning with Personalization Layers
• Differentially Private Federated Learning: A Client Level Perspective
• Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
• EMNIST: an extension of MNIST to handwritten letters
• Asynchronous Federated Optimization
• Mitigating Sybils in Federated Learning Poisoning
• Fair Resource Allocation in Federated Learning
• Learning Activation Functions to Improve Deep Neural Networks
• A generic framework for privacy preserving deep learning
• LEAF: A Benchmark for Federated Settings
• Federated Meta-Learning with Fast Convergence and Efficient Communication
• Agnostic Federated Learning
• Sparsified SGD with Memory
• Don't Use Large Mini-Batches, Use Local SGD
• ATOMO: Communication-efficient Learning via Atomic Sparsification
• Split learning for health: Distributed deep learning without sharing raw patient data
• Expanding the Reach of Federated Learning by Reducing Client Resource Requirements
• Distributed Mean Estimation with Limited Communication
• Communication-Efficient Distributed Dual Coordinate Ascent
• Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computing
• A Communication Efficient Collaborative Learning Framework for Distributed Features
• Boosting Privately: Privacy-Preserving Federated Extreme Boosting for Mobile Crowdsensing
• Federated Learning via Over-the-Air Computation
• Detailed comparison of communication efficiency of split learning and federated learning
• Broadband Analog Aggregation for Low-Latency Federated Edge Learning (Extended Version)
• Incentive Design for Efficient Federated Learning in Mobile Networks: A Contract Theory Approach
• Convergence Time Optimization for Federated Learning over Wireless Networks
• Collaborative Artificial Intelligence (AI) for User-Cell association in Ultra-Dense Cellular Systems
• Client-Edge-Cloud Hierarchical Federated Learning
• Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data
• Blockchained On-Device Federated Learning
• Federated AI for building AI Solutions across Multiple Agencies
• Exploiting Unlabeled Data in Smart Cities using Federated Learning
• Joint Service Pricing and Cooperative Relay Communication for Federated Learning
• Federated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks
• Efficient Training Management for Mobile Crowd-Machine Learning: A Deep Reinforcement Learning Approach

Cited by in corpus (21)

• Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
• Blockchain for 5G and Beyond Networks: A State of the Art Survey
• Edge Intelligence: Architectures, Challenges, and Applications
• An Overview of Federated Learning at the Edge and Distributed Ledger Technologies for Robotic and Autonomous Systems
• Federated Learning for Healthcare Informatics
• Machine Learning in NextG Networks via Generative Adversarial Networks
• Local Differential Privacy based Federated Learning for Internet of Things
• Towards Federated Learning in UAV-Enabled Internet of Vehicles: A Multi-Dimensional Contract-Matching Approach
• Distributed Vehicular Computing at the Dawn of 5G: a Survey
• FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing
• Exploiting Unlabeled Data in Smart Cities using Federated Learning
• Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
• Efficient Sparse Secure Aggregation for Federated Learning
• Toward an Automated Auction Framework for Wireless Federated Learning Services Market
• Wireless for Machine Learning
• HierTrain: Fast Hierarchical Edge AI Learning with Hybrid Parallelism in Mobile-Edge-Cloud Computing
• Improved Convergence Analysis and SNR Control Strategies for Federated Learning in the Presence of Noise
• Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning
• Adaptive Subcarrier, Parameter, and Power Allocation for Partitioned Edge Learning Over Broadband Channels
• Assessing the Feasibility of Web-Request Prediction Models on Mobile Platforms
• Budgeted Online Selection of Candidate IoT Clients to Participate in Federated Learning