Beyond Attention Scores: SVD-Based Vision Token Pruning for Efficient Vision-Language Models

Yvon Apedo, Martyna Poreba, Michal Szczepanski +1

Vision-Language Models (VLMs) have revolutionized multi-modal learning by jointly processing visual and textual information. Yet, they face significant challenges due to the high c…