Layer-Parallel Inference Reduces Encrypted Nonlinear Depth in Transformers

Ligong Han, Kai Xu, Hao Wang +3

Fully homomorphic encryption (FHE) enables computation on encrypted data, but practical encrypted Transformer inference is bottlenecked by the sequential composition of many nonlin…