SCOPD: Sparse-Context On-Policy Self-Distillation for Efficient Vision-Language Models

Ahmadreza Jeddi, Enming Zhang, Jasper Gerigk +12

Reasoning vision-language models (VLMs) process images and videos as long sequences of visual tokens, making inference expensive. Training-free token pruning reduces this cost, but…