MPC-Minimized Secure LLM Inference

Deevashwer Rathee, Dacheng Li, Ion Stoica +2

Many inference services based on large language models (LLMs) pose a privacy concern, either revealing user prompts to the service or the proprietary weights to the user. Secure in…