2 papers
cs.DC2026
A CXL Memory Rack for Multi-Turn LLM Serving
Hakbeom Jang, Inho Song, Sam H. Noh +2
Long-context, multi-turn, and agentic LLM workloads increasingly reuse previously processed context, making KV-cache reuse essential for reducing redundant computation. However, th…
cs.DC2026
ITME: Inference Tiered Memory Expansion with Disaggregated CXL-Hybrid Memories
Hakbeom Jang, Younghoon Min, Sunwoong Kim +5
The rapid shift toward agentic and long-context workloads in Large Language Models (LLMs) is pushing the industry beyond the capacity of individual servers toward disaggregated sha…