3 papers
cs.AI2026
RedKnot-MLA: Multi-Head Offline-Online Reuse for DeepSeek-V4 Long-Context Serving
Yang Liu, Zhaokai Luo, Huayi Jin +10
Multi-head latent attention (MLA) exposes many logical query heads through one packed latent KV stream. This representation is memory efficient, but it removes the physical per-hea…
cs.DC2026
HYPIC: Accelerating Hybrid-Attention LLM Serving with Position-Independent Caching
Yifei Liu, Juntong Wu, Yang Liu +4
In retrieval-augmented generation and agentic LLM serving, prompts are assembled from independent segments into long contexts, making the prefill stage dominate per-request cost. T…
cs.AI2026
Akashic: A Low-Overhead LLM Inference Service with MemAttention
Yang Liu, Zhaokai Luo, Huayi Jin +7
Recent LLM-based agent systems continuously accumulate context across multi-turn interactions, tool invocations, and cross-session workflows. Replaying the full history for every r…