Towards Federated Learning at Scale: System Design
arXiv:1902.01046
Abstract
Federated Learning is a distributed machine learning approach which enables model training on a large corpus of decentralized data. We have built a scalable production system for Federated Learning in the domain of mobile devices, based on TensorFlow. In this paper, we describe the resulting high-level design, sketch some of the challenges and their solutions, and touch upon the open problems and future directions.
References in corpus (2)
Cited by in corpus (48)
- Multi-Armed Bandit Based Client Scheduling for Federated Learning
- BrainTorrent: A Peer-to-Peer Environment for Decentralized Federated Learning
- Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacy
- Backdoor Attacks and Countermeasures on Deep Learning: A Comprehensive Review
- Abnormal Client Behavior Detection in Federated Learning
- IBM Federated Learning: an Enterprise Framework White Paper V0.1
- Attack of the Tails: Yes, You Really Can Backdoor Federated Learning
- 6G White paper: Research challenges for Trust, Security and Privacy
- Federated Learning with Matched Averaging
- FedSplit: An algorithmic framework for fast federated optimization
- Client Selection in Federated Learning: Convergence Analysis and Power-of-Choice Selection Strategies
- Private Federated Learning with Domain Adaptation
- Orthogonal Gradient Descent for Continual Learning
- Triggerflow: Trigger-based Orchestration of Serverless Workflows
- Faster On-Device Training Using New Federated Momentum Algorithm
- Towards Ubiquitous AI in 6G with Federated Learning
- Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms
- FedVision: An Online Visual Object Detection Platform Powered by Federated Learning
- LDP-Fed: Federated Learning with Local Differential Privacy
- Federated Dynamic GNN with Secure Aggregation
- Understanding Unintended Memorization in Federated Learning
- Preserving Patient Privacy while Training a Predictive Model of In-hospital Mortality
- Asynchronous Federated Learning with Reduced Number of Rounds and with Differential Privacy from Less Aggregated Gaussian Noise
- Training Production Language Models without Memorizing User Data
- Joint Device Scheduling and Resource Allocation for Latency Constrained Wireless Federated Learning
- Proof of Federated Learning: A Novel Energy-recycling Consensus Algorithm
- Substra: a framework for privacy-preserving, traceable and collaborative Machine Learning
- Privacy-Preserving Blockchain Based Federated Learning with Differential Data Sharing
- Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving
- Privacy-Preserving Multi-Party Contextual Bandits
- Neurosciences and 6G: Lessons from and Needs of Communicative Brains
- Revocable Federated Learning: A Benchmark of Federated Forest
- SAPAG: A Self-Adaptive Privacy Attack From Gradients
- SECure: A Social and Environmental Certificate for AI Systems
- Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning
- MAB-based Client Selection for Federated Learning with Uncertain Resources in Mobile Networks
- Ethics of Artificial Intelligence in Surgery
- A Survey on Large-scale Machine Learning
- Adaptive Distillation for Decentralized Learning from Heterogeneous Clients
- Accelerating Federated Learning in Heterogeneous Data and Computational Environments
- TiFL: A Tier-based Federated Learning System
- Federated Extra-Trees with Privacy Preserving
- Optimizing Over-the-Air Computation in IRS-Aided C-RAN Systems
- MDLdroid: a ChainSGD-reduce Approach to Mobile Deep Learning for Personal Mobile Sensing
- Federated Classification using Parsimonious Functions in Reproducing Kernel Hilbert Spaces
- OL4EL: Online Learning for Edge-cloud Collaborative Learning on Heterogeneous Edges with Resource Constraints
- Preventing Adversarial Use of Datasets through Fair Core-Set Construction
- Consensus Driven Learning