Gecko: Fast Private Inference via Secure Public Encoder Offloading

Cheng'an Wei, Kai Chen, Yue Zhao +2

Private inference protects both user inputs and server models during neural network inference, but existing solutions remain too slow for practical deployment. This motivates recen…