2 papers
cs.LG2026
High-accuracy Low-Bit KV-Cache Quantization via Local Distribution Restoration
Gradwell Dzikanyanga, Yanqi Pan, Weihao Yang +3
Long-context large language model inference relies on the KV cache to avoid redundant attention computation, but incurs high memory and bandwidth overheads. Low-bit KV-cache quanti…
cs.CL2026
TTKV: Temporal-Tiered KV Cache for Long-Context LLM Inference
Gradwell Dzikanyanga, Weihao Yang, Hao Huang +4
Key-value (KV) caching is critical for efficient inference in large language models (LLMs), yet its memory footprint scales linearly with context length, resulting in a severe scal…