InferScale: GPU-Native KV Injection for Personalized LLM Serving

Peter Li, Prashant Pandey

Large language models are increasingly deployed with persistent personalized context, such as accumulated memory profiles or long conversation histories, that is shared across a us…