KV-Rescue: Recovering Reasoning Language Model KV Eviction Loss via Stepwise Interleaving

Minsoo Cheong, Woosang Lim, Vincent-Daniel Yun +1

KV-cache eviction caps the memory cost of long reasoning traces but is inherently lossy because the model decodes from a partial view of its history. Under aggressive budgets, this…