A CXL Memory Rack for Multi-Turn LLM Serving

Hakbeom Jang, Inho Song, Sam H. Noh +2

Long-context, multi-turn, and agentic LLM workloads increasingly reuse previously processed context, making KV-cache reuse essential for reducing redundant computation. However, th…