Fiona: Accelerating FHE Inference with Packing-Aware Ternary Weights

Yiteng Peng, Zhibo Liu, Dongwei Xiao +1

Fully homomorphic encryption (FHE) enables neural network inference directly on encrypted inputs, but it remains orders of magnitude slower than plaintext in- ference. Applying the…