works on
gpu acceleration 1inference optimization 1kv cache 1large language models 1personalized memory 1

From the 1 of 1 linked paper with an AI index.

collaborators

1 paper

cs.DC2026

InferScale: GPU-Native KV Injection for Personalized LLM Serving

Peter Li, Prashant Pandey

The paper introduces InferScale, a GPU-native system that precomputes and caches key‑value (KV) representations of personalized memory facts for large language models, allowing dir…