Budgeted KV-Cache Repair for Evolving Contexts

Han Yu, Wenhui Zhu, Jincheng Cao +15

Language-model agents revise their working context as information becomes obsolete, but deleting text does not erase its influence on cached computation. Later key-value (KV) state…