Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

Abstract

By leveraging deep learning based technologies, the data-driven based approaches have reached great success with the rapid increase of data generated of Industrial Indernet of Things(IIot). However, security and privacy concerns are obstacles for data providers in many sensitive data-driven industrial scenarios, such as healthcare and auto-driving. Many Federated Learning(FL) approaches have been proposed with DNNs for IIoT applications, these works still suffer from low usability of data due to data incompleteness, low quality, insufficient quantity, sensitivity, etc. Therefore, we propose a ring-topogy based decentralized federated learning(RDFL) scheme for Deep Generative Models(DGMs), where DGMs is a promising solution for solving the aforementioned data usability issues. Compare with existing IIoT FL works, our RDFL schemes provides communication efficiency and maintain training performance to boost DGMs in target IIoT tasks. A novel ring FL topology as well as a map-reduce based synchronizing method are designed in the proposed RDFL to improve decentralized FL performance and bandwidth utilization. In addition, InterPlanetary File System(IPFS) is introduced to further improve communication efficiency and FL security. Extensive experiments have been taken to demonstate the superiority of RDFL with either independent and identically distributed(IID) datasets or non-independent and identically distributed(Non-IID) datasets.

arXiv admin note: text overlap with arXiv:2010.10996

References in corpus (21)

• Communication-Efficient Learning of Deep Networks from Decentralized Data
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Federated Learning: Strategies for Improving Communication Efficiency
• Federated Learning with Non-IID Data
• Privacy-preserving Traffic Flow Prediction: A Federated Learning Approach
• A Blockchain-based Decentralized Federated Learning Framework with Committee Consensus
• Differentially Private Federated Learning: A Client Level Perspective
• Federated Learning with Cooperating Devices: A Consensus Approach for Massive IoT Networks
• Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
• FedML: A Research Library and Benchmark for Federated Machine Learning
• Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data
• A generic framework for privacy preserving deep learning
• LEAF: A Benchmark for Federated Settings
• Communication Compression for Decentralized Training
• Decentralized Federated Learning: A Segmented Gossip Approach
• Central Server Free Federated Learning over Single-sided Trust Social Networks
• Generative Models for Effective ML on Private, Decentralized Datasets
• Federated Learning With Quantized Global Model Updates
• FedGAN: Federated Generative Adversarial Networks for Distributed Data
• Decentralized Learning of Generative Adversarial Networks from Non-iid Data
• Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection