VisCache: Visual KV Cache Pruning for Efficient Vision Large Language Model Inference

Lyuke Wang, Zhuo Li, Guangxu Zhu

While Vision Large Language Models (VLLMs) have achieved remarkable success in multimodal reasoning, their long-context inference remains prohibitively expensive due to the massive…