Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge

Abstract

We envision a mobile edge computing (MEC) framework for machine learning (ML) technologies, which leverages distributed client data and computation resources for training high-performance ML models while preserving client privacy. Toward this future goal, this work aims to extend Federated Learning (FL), a decentralized learning framework that enables privacy-preserving training of models, to work with heterogeneous clients in a practical cellular network. The FL protocol iteratively asks random clients to download a trainable model from a server, update it with own data, and upload the updated model to the server, while asking the server to aggregate multiple client updates to further improve the model. While clients in this protocol are free from disclosing own private data, the overall training process can become inefficient when some clients are with limited computational resources (i.e. requiring longer update time) or under poor wireless channel conditions (longer upload time). Our new FL protocol, which we refer to as FedCS, mitigates this problem and performs FL efficiently while actively managing clients based on their resource conditions. Specifically, FedCS solves a client selection problem with resource constraints, which allows the server to aggregate as many client updates as possible and to accelerate performance improvement in ML models. We conducted an experimental evaluation using publicly-available large-scale image datasets to train deep neural networks on MEC environment simulations. The experimental results show that FedCS is able to complete its training process in a significantly shorter time compared to the original FL protocol.

References in corpus (1)

• Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge Computing

Cited by in corpus (54)

• Federated Learning: Challenges, Methods, and Future Directions
• A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection
• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless Sensing
• Distributed Federated Learning for Ultra-Reliable Low-Latency Vehicular Communications
• SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overhead
• Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data
• Multi-Armed Bandit Based Client Scheduling for Federated Learning
• AI based Service Management for 6G Green Communications
• An Efficiency-boosting Client Selection Scheme for Federated Learning with Fairness Guarantee
• Pervasive AI for IoT applications: A Survey on Resource-efficient Distributed Artificial Intelligence
• Analysis and Optimal Edge Assignment For Hierarchical Federated Learning on Non-IID Data
• Towards Fairness-Aware Federated Learning
• Decentralized Federated Learning via Mutual Knowledge Transfer
• A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving Services
• Resource-Efficient Federated Learning
• An Efficient and Reliable Asynchronous Federated Learning Scheme for Smart Public Transportation
• Federated Learning over Energy Harvesting Wireless Networks
• Improving Fairness for Data Valuation in Horizontal Federated Learning
• Study of the performance and scalability of federated learning for medical imaging with intermittent clients
• FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems
• Decentralized Deep Learning for Multi-Access Edge Computing: A Survey on Communication Efficiency and Trustworthiness
• Advances in Robust Federated Learning: A Survey with Heterogeneity Considerations
• FLAME: Federated Learning Across Multi-device Environments
• Privacy and Trust Redefined in Federated Machine Learning
• Time-sensitive Learning for Heterogeneous Federated Edge Intelligence
• E-Tree Learning: A Novel Decentralized Model Learning Framework for Edge AI
• Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies
• Data-Quality Based Scheduling for Federated Edge Learning
• AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices
• Graph Federated Learning for CIoT Devices in Smart Home Applications
• Edge-assisted Democratized Learning Towards Federated Analytics
• Multi-Model Federated Learning
• Fed-ensemble: Improving Generalization through Model Ensembling in Federated Learning
• A Contribution-based Device Selection Scheme in Federated Learning
• Federated Few-Shot Learning for Mobile NLP
• Towards Reliable Participation in UAV-Enabled Federated Edge Learning on Non-IID Data
• An On-Device Federated Learning Approach for Cooperative Model Update between Edge Devices
• FedGreen: Federated Learning with Fine-Grained Gradient Compression for Green Mobile Edge Computing
• Accelerating Vertical Federated Learning
• Federated Learning for Energy Constrained IoT devices: A systematic mapping study
• FedDCT: Federated Learning of Large Convolutional Neural Networks on Resource Constrained Devices using Divide and Collaborative Training
• EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control
• Combining Federated Learning and Control: A Survey
• CommunityAI: Towards Community-based Federated Learning
• FedFm: Towards a Robust Federated Learning Approach For Fault Mitigation at the Edge Nodes
• An Element-Wise Weights Aggregation Method for Federated Learning
• From Learning to Analytics: Improving Model Efficacy with Goal-Directed Client Selection
• Benchmarking Federated Learning in Edge Computing Environments: A Systematic Review and Performance Evaluation
• Inclusive Data Representation in Federated Learning: A Novel Approach Integrating Textual and Visual Prompt
• Adaptively Weighted Averaging Over-the-Air Computation and Its Application to Distributed Gaussian Process Regression
• Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review
• Security and Privacy Issues and Solutions in Federated Learning for Digital Healthcare
• MMiC: Mitigating Modality Incompleteness in Clustered Federated Learning