VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference

Shengling Qin, Hao Yu, Chenxin Wu +10

This paper presents VLCache, a cache reuse framework that exploits both Key-Value (KV) cache and encoder cache from prior multimodal inputs to eliminate costly recomputation when t…