When to Evict, Not What to Keep: Draft-Guided Eviction for Training-Free KV-Cache Compression

Haeyong Kang, Chang D. Yoo

Training-free KV-cache compression methods such as SnapKV, H2O, and PyramidKV evict tokens at the end of prefill, aiming to preserve the attention mass that future queries are expe…