SparseEngine: Sparse-First Inference Engine

Jitai Hao, Quansheng Gu, Qiang Huang +1

Long-context LLM agents accumulate interaction histories that strain KV-cache memory and attention computation. Although sparse attention reduces these costs, heterogeneous cache r…