Information-Aware KV Cache Compression for Long Reasoning

Jushi Kai, Zhuiri Xiao, Alexandra Birch +1

Reasoning capability has advanced rapidly in large language models (LLMs), leading to an increasing size of key-value (KV) cache in both prefilling and decoding stages. Existing KV…