Shallow to Deep: Aligning Token Pruning with Stage-wise Roles in LVLMs

Shuo Zhang, Jintao Tong, Yixiong Zou +2

Large Vision-Language Models (LVLMs) incur high computational costs from redundant visual tokens. Although training-free attention-based multi-layer pruning in the vision encoder s…