More Industry-friendly: Federated Learning with High Efficient Design
arXiv:2012.08809
Abstract
Although many achievements have been made since Google threw out the paradigm of federated learning (FL), there still exists much room for researchers to optimize its efficiency. In this paper, we propose a high efficient FL method equipped with the double head design aiming for personalization optimization over non-IID dataset, and the gradual model sharing design for communication saving. Experimental results show that, our method has more stable accuracy performance and better communication efficient across various data distributions than other state of art methods (SOTAs), makes it more industry-friendly.
References in corpus (14)
- Distilling the Knowledge in a Neural Network
- Communication-Efficient Learning of Deep Networks from Decentralized Data
- Federated Learning: Strategies for Improving Communication Efficiency
- Federated Learning with Non-IID Data
- Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
- Adaptive Personalized Federated Learning
- LEAF: A Benchmark for Federated Settings
- Federated Learning of a Mixture of Global and Local Models
- Think Locally, Act Globally: Federated Learning with Local and Global Representations
- Communication-Efficient Distributed Deep Learning: A Comprehensive Survey
- LotteryFL: Personalized and Communication-Efficient Federated Learning with Lottery Ticket Hypothesis on Non-IID Datasets
- Salvaging Federated Learning by Local Adaptation
- Characterizing Impacts of Heterogeneity in Federated Learning upon Large-Scale Smartphone Data
- Label Mapping Neural Networks with Response Consolidation for Class Incremental Learning