2 papers
cs.DC2026
SAC: Disaggregated KV Cache System for Sparse Attention LLMs with CXL
Ruiyang Ma, Teng Ma, Junru Li +7
The scaling of LLMs toward long-context inference has shifted the primary serving system bottleneck from computation to memory capacity. Traditional solutions for dense attention m…
cs.AR2026
Pooling Engram Conditional Memory in Large Language Models using CXL
Ruiyang Ma, Teng Ma, Zhiyuan Su +11
Engram conditional memory has emerged as a promising component for LLMs by decoupling static knowledge lookup from dynamic computation. Since Engram exhibits sparse access patterns…