Federated Learning for Energy Constrained IoT devices: A systematic mapping study

Abstract

Federated Machine Learning (Fed ML) is a new distributed machine learning technique applied to collaboratively train a global model using clients local data without transmitting it. Nodes only send parameter updates (e.g., weight updates in the case of neural networks), which are fused together by the server to build the global model. By not divulging node data, Fed ML guarantees its confidentiality, a crucial aspect of network security, which enables it to be used in the context of data-sensitive Internet of Things (IoT) and mobile applications, such as smart Geo-location and the smart grid. However, most IoT devices are particularly energy constrained, which raises the need to optimize the Fed ML process for efficient training tasks and optimized power consumption. In this paper, we conduct, to the best of our knowledge, the first Systematic Mapping Study (SMS) on Fed ML optimization techniques for energy-constrained IoT devices. From a total of more than 800 papers, we select 67 that satisfy our criteria and give a structured overview of the field using a set of carefully chosen research questions. Finally, we attempt to provide an analysis of the energy-constrained Fed ML state of the art and try to outline some potential recommendations for the research community.

arXiv comment27 pages

References in corpus (20)

• Distilling the Knowledge in a Neural Network
• Federated Learning: Challenges, Methods, and Future Directions
• Federated Learning with Non-IID Data
• Federated Optimization: Distributed Machine Learning for On-Device Intelligence
• Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge
• The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
• QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding
• Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation
• Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
• SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overhead
• FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization
• Astraea: Self-balancing Federated Learning for Improving Classification Accuracy of Mobile Deep Learning Applications
• HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients
• Understanding Top-k Sparsification in Distributed Deep Learning
• Model Pruning Enables Efficient Federated Learning on Edge Devices
• Faster On-Device Training Using New Federated Momentum Algorithm
• Federated Knowledge Distillation
• Distilling On-Device Intelligence at the Network Edge
• A Systematic Literature Review on Federated Learning: From A Model Quality Perspective
• Communication-Efficient Federated Learning with Dual-Side Low-Rank Compression