Attention Debiasing for Token Pruning in Vision Language Models

Kai Zhao, Wubang Yuan, Yuchen Lin +5

Vision-language models (VLMs) typically encode substantially more visual tokens than text tokens, resulting in significant token redundancy. Pruning uninformative visual tokens is…