Multi-hop Federated Private Data Augmentation with Sample Compression

Abstract

On-device machine learning (ML) has brought about the accessibility to a tremendous amount of data from the users while keeping their local data private instead of storing it in a central entity. However, for privacy guarantee, it is inevitable at each device to compensate for the quality of data or learning performance, especially when it has a non-IID training dataset. In this paper, we propose a data augmentation framework using a generative model: multi-hop federated augmentation with sample compression (MultFAug). A multi-hop protocol speeds up the end-to-end over-the-air transmission of seed samples by enhancing the transport capacity. The relaying devices guarantee stronger privacy preservation as well since the origin of each seed sample is hidden in those participants. For further privatization on the individual sample level, the devices compress their data samples. The devices sparsify their data samples prior to transmissions to reduce the sample size, which impacts the communication payload. This preprocessing also strengthens the privacy of each sample, which corresponds to the input perturbation for preserving sample privacy. The numerical evaluations show that the proposed framework significantly improves privacy guarantee, transmission delay, and local training performance with adjustment to the number of hops and compression rate.

to be presented at the 28th International Joint Conference on Artificial Intelligence (IJCAI-19), 1st International Workshop on Federated Machine Learning for User Privacy and Data Confidentiality (FML'19), Macao, China

References in corpus (6)

• Conditional Generative Adversarial Nets
• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Communication-Efficient On-Device Machine Learning: Federated Distillation and Augmentation under Non-IID Private Data
• Data Augmentation in Emotion Classification Using Generative Adversarial Networks
• Decentralized Learning of Generative Adversarial Networks from Non-iid Data
• Hybrid-FL for Wireless Networks: Cooperative Learning Mechanism Using Non-IID Data

Cited by in corpus (4)

• A Joint Learning and Communications Framework for Federated Learning over Wireless Networks
• Energy Efficient Federated Learning Over Wireless Communication Networks
• Distilling On-Device Intelligence at the Network Edge
• Decentralized and Model-Free Federated Learning: Consensus-Based Distillation in Function Space