SAC: Disaggregated KV Cache System for Sparse Attention LLMs with CXL

Ruiyang Ma, Teng Ma, Junru Li +7

The scaling of LLMs toward long-context inference has shifted the primary serving system bottleneck from computation to memory capacity. Traditional solutions for dense attention m…