CacheClip: Accelerating RAG with Effective KV Cache Reuse

Bin Yang, Qiuyu Leng, Jun Zeng +1

Retrieval-Augmented Generation (RAG) systems suffer from severe time-to-first-token (TTFT) bottlenecks due to long input sequences. Existing KV cache reuse methods face a fundament…