Privacy-Preserving Inference for Quantized BERT Models

Tianpei Lu, Bingsheng Zhang, Lekun Peng +3

With the increasing deployment of generative machine learning models in privacy-sensitive domains such as healthcare and personalized services, ensuring secure inference has become…