ESS: An Offload-Centric Latent-Cache Management Architecture for DeepSeek-V3.2-Exp

Xinhang Chen, Chao Zhang, Jiahuan He +9

DeepSeek-V3.2-Exp introduces a sparse attention mechanism that significantly reduces inference latency in long-context scenarios. Although the overall throughput has improved great…