Here is a GIFT: Enforcing User Data Isolation in LLM Serving via GPU Information Flow Tracking

Jiacheng Shi, Xunjie Wang, Cheng Tan +1

LLM serving frameworks process large volumes of user data--often containing sensitive information--on shared infrastructure. Ensuring isolation between users who share the same ser…