ValueDiff: Value-Geometric KV Cache Eviction for Sink-Suppressed LLMs

Junyoung Park, Jungwook Choi, Mingu Lee

Modern LLMs with QK-normalization, gated attention, learned attention sinks, or logit softcapping exhibit weaker persistent attention sinks, on which existing KV cache eviction met…