Rotation-Aligned Key Channel Pruning for Efficient Vision-Language Model Inference

Beomseok Kang, Dongwon Jo, Jiwon Song +2

Vision-Language Models suffer severe KV cache pressure at inference, as a single image often encodes into thousands of tokens. Most existing methods exploit token sparsity through…