General Techniques for Reducing Key-Switching Overhead in Privacy-Preserving Two-Party Transformer Inference

Wenshao Yang, Zhenhua Liu, Dongdong Yao

In secure two-party Transformer inference, linear layers are typically evaluated using Fully Homomorphic Encryption (FHE) through plaintext-ciphertext or ciphertext-ciphertext matr…