Representation Dynamics Reveal Semantic Saliency and Similarity for Visual Token Pruning in MLLMs

Weixuan Li, Zikun Zhou, Xinyi Zhuang +4

Multimodal large language models (MLLMs) incur high inference latency from long visual token sequences. Existing pruning methods commonly use attention maps or output features to e…