ETC: Extreme Token Compression via Task-aware Visual Information Distillation in VLMs

Yiling Gao, Hongchen Wei, Zhenzhong Chen

In Vision-Language Models (VLMs), high-resolution images produce a large number of visual tokens, resulting in high computational costs and KV-cache overhead during inference. To a…