When Classic Cache Policies Fail: Learning-Augmented Replacement for Semantic Retrieval Buffers

Yushi Sun, Bowen Cao, Wai Lam

LLM agents increasingly rely on retrieval buffers to store and reuse past experience, yet the cache management policies governing these buffers remain largely ad-hoc. We formalize…