Budgeted Cache Repair for Cross-Context KV-Cache Reuse

Haeyong Kang, Chang D. Yoo

Cross-context KV-cache reuse predicts a shared segment's keys and values under a new prefix instead of recomputing them, and has been reported to do so without quality loss. We fin…