A CXL Memory Rack for Multi-Turn LLM Serving

Hakbeom Jang, Inho Song, Hoshik Kim +2

Long-context, multi-turn, and agentic LLM workloads increasingly reuse previously processed context, making KV-cache reuse essential for reducing redundant computation. However, th…