2 citations · 2 across the 4 of their papers we have counts for
1 paper · 1 filter
Pankaj Kumar, Subhankar Mishra
KV-cache eviction can do more than compress. In long-context LLMs, keeping only some cached tokens sometimes matches or exceeds full-cache accuracy, because many redundant prefill…