2 papers
cs.AI2026
Akashic: A Low-Overhead LLM Inference Service with MemAttention
Yang Liu, Zhaokai Luo, Huayi Jin +7
Recent LLM-based agent systems continuously accumulate context across multi-turn interactions, tool invocations, and cross-session workflows. Replaying the full history for every r…
cs.AI2026
RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
Yang Liu, ZhaoKai Luo, Zhaokai Luo +11
As the input length of large language model (LLM) serving continues to grow, the KV cache has become a dominant bottleneck in AI infrastructure. It limits GPU memory capacity, serv…