RetentiveKV: State-Space Memory for Uncertainty-Aware Multimodal KV Cache Eviction

Sihao Liu, YuFan Xiong, Zhonghua Jiang +2

Multimodal Large Language Models face severe challenges in computational efficiency and memory consumption due to the substantial expansion of the visual KV cache when processing l…