HAWK: Head Importance-Aware Visual Token Pruning in Multimodal Models

Qihui Zhu, Tao Zhang, Yuchen Wang +9

In multimodal large language models (MLLMs), the surge of visual tokens significantly increases the inference time and computational overhead, making them impractical for real-time…