PrivFT: Private and Fast Text Classification with Homomorphic Encryption

Abstract

The need for privacy-preserving analytics is higher than ever due to the severity of privacy risks and to comply with new privacy regulations leading to an amplified interest in privacy-preserving techniques that try to balance between privacy and utility. In this work, we present an efficient method for Text Classification while preserving the privacy of the content using Fully Homomorphic Encryption (FHE). Our system (named \textbf{Priv}ate \textbf{F}ast \textbf{T}ext (PrivFT)) performs two tasks: 1) making inference of encrypted user inputs using a plaintext model and 2) training an effective model using an encrypted dataset. For inference, we train a supervised model and outline a system for homomorphic inference on encrypted user inputs with zero loss to prediction accuracy. In the second part, we show how to train a model using fully encrypted data to generate an encrypted model. We provide a GPU implementation of the Cheon-Kim-Kim-Song (CKKS) FHE scheme and compare it with existing CPU implementations to achieve 1 to 2 orders of magnitude speedup at various parameter settings. We implement PrivFT in GPUs to achieve a run time per inference of less than 0.66 seconds. Training on a relatively large encrypted dataset is more computationally intensive requiring 5.04 days.

13 pages, 3 figures, 4 tables, 5 Algorithms

References in corpus (9)

• Efficient Estimation of Word Representations in Vector Space
• Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour
• Regularizing and Optimizing LSTM Language Models
• Learning to Generate Reviews and Discovering Sentiment
• Machine Ethics and Automated Vehicles
• Faster CryptoNets: Leveraging Sparsity for Real-World Encrypted Inference
• Encrypted statistical machine learning: new privacy preserving methods
• Towards the AlexNet Moment for Homomorphic Encryption: HCNN, theFirst Homomorphic CNN on Encrypted Data with GPUs
• Privacy-Preserving Classification of Personal Text Messages with Secure Multi-Party Computation: An Application to Hate-Speech Detection

Cited by in corpus (5)

• BTS: An Accelerator for Bootstrappable Fully Homomorphic Encryption
• ARK: Fully Homomorphic Encryption Accelerator with Runtime Data Generation and Inter-Operation Key Reuse
• GME: GPU-based Microarchitectural Extensions to Accelerate Homomorphic Encryption
• Fast and Accurate Homomorphic Softmax Evaluation
• CryptoGRU: Low Latency Privacy-Preserving Text Analysis With GRU