14 citations · 24 across the 9 of their papers we have counts for
8 papers · 1 filter
Network and Compiler Optimizations for Efficient Linear Algebra Kernels in Private Transformer Inference
Karthik Garimella, Negar Neda, Austin Ebel +2
Large language model (LLM) based services are primarily structured as client-server interactions, with clients sending queries directly to cloud providers that host LLMs. This appr…
EinHops: Einsum Notation for Expressive Homomorphic Operations on RNS-CKKS Tensors
Karthik Garimella, Austin Ebel, Brandon Reagen
Fully Homomorphic Encryption (FHE) is an encryption scheme that allows for computation to be performed directly on encrypted data, effectively closing the loop on secure and outsou…
HE-LRM: Encrypted Deep Learning Recommendation Models using Fully Homomorphic Encryption
Karthik Garimella, Austin Ebel, Gabrielle De Micheli +1
Fully Homomorphic Encryption (FHE) enables computation directly on encrypted data and privacy-preserving neural inference in the cloud. Existing solutions focus on models with dens…
TruncFormer: Private LLM Inference Using Only Truncations
Patrick Yubeaton, Jianqiao Cambridge Mo, Karthik Garimella +4
Private inference (PI) serves an important role in guaranteeing the privacy of user data when interfacing with proprietary machine learning models such as LLMs. However, PI remains…
Orion: A Fully Homomorphic Encryption Framework for Deep Learning
Austin Ebel, Karthik Garimella, Brandon Reagen
Fully Homomorphic Encryption (FHE) has the potential to substantially improve privacy and security by enabling computation directly on encrypted data. This is especially true with…
Towards Fast and Scalable Private Inference
Jianqiao Mo, Karthik Garimella, Negar Neda +2
Privacy and security have rapidly emerged as first order design constraints. Users now demand more protection over who can see their data (confidentiality) as well as how it is use…
Characterizing and Optimizing End-to-End Systems for Private Inference
Karthik Garimella, Zahra Ghodsi, Nandan Kumar Jha +2
In two-party machine learning prediction services, the client's goal is to query a remote server's trained machine learning model to perform neural network inference in some applic…
CryptoNite: Revealing the Pitfalls of End-to-End Private Inference at Scale
Karthik Garimella, Nandan Kumar Jha, Zahra Ghodsi +2
The privacy concerns of providing deep learning inference as a service have underscored the need for private inference (PI) protocols that protect users' data and the service provi…