Accelerating Private Large Transformers Inference through Fine-grained Collaborative Computation

Yuntian Chen, Zhanyong Tang, Tianpei Lu +3

Homomorphic encryption (HE) and secret sharing (SS) enable computations on encrypted data, providing significant privacy benefits for large transformer-based models (TBM) in sensit…