FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learning

Abstract

Homomorphic encryption (HE) is a promising privacy-preserving technique for cross-silo federated learning (FL), where organizations perform collaborative model training on decentralized data. Despite the strong privacy guarantee, general HE schemes result in significant computation and communication overhead. Prior works employ batch encryption to address this problem, but it is still suboptimal in mitigating communication overhead and is incompatible with sparsification techniques. In this paper, we propose FLASHE, an HE scheme tailored for cross-silo FL. To capture the minimum requirements of security and functionality, FLASHE drops the asymmetric-key design and only involves modular addition operations with random numbers. Depending on whether to accommodate sparsification techniques, FLASHE is optimized in computation efficiency with different approaches. We have implemented FLASHE as a pluggable module atop FATE, an industrial platform for cross-silo FL. Compared to plaintext training, FLASHE slightly increases the training time by $\le 6\%$, with no communication overhead.

arXiv comment12 pages, 13 figures

References in corpus (8)

• Communication-Efficient Learning of Deep Networks from Decentralized Data
• Secure Federated Transfer Learning
• A generic framework for privacy preserving deep learning
• LEAF: A Benchmark for Federated Settings
• Adaptive Federated Optimization
• Personalized Cross-Silo Federated Learning on Non-IID Data
• TenSEAL: A Library for Encrypted Tensor Operations Using Homomorphic Encryption
• Federated Learning of N-gram Language Models

Cited by in corpus (3)

• Towards Efficient Synchronous Federated Training: A Survey on System Optimization Strategies
• Federated learning with differential privacy and an untrusted aggregator
• Federated Learning is Better with Non-Homomorphic Encryption