A Scalable Multi-GPU Framework for Encrypted Large-Model Inference

Siddharth Jayashankar, Joshua Kim, Michael B. Sullivan +2

Encrypted AI using fully homomorphic encryption (FHE) provides strong privacy guarantees; but its slow performance has limited practical deployment. Recent works proposed ASICs to…