HEAT: Faster Fully Homomorphic Inference via Approximations-Weights Co-Adaptation

Alessandro Zirilli, Davide Marincione, Evgenios M. Kornaropoulos +2

Fully homomorphic encryption (FHE) allows a server to run a language model directly on encrypted user prompts, but current approaches remain prohibitively slow. Ciphertexts nativel…