HeadGuard: Selective Head Protection for Low-Bit VLM KV-Cache Quantization

Nenad Banfic

Low-bit key-value (KV) cache quantization saves storage but can sharply degrade vision-language model (VLM) accuracy. We introduce HeadGuard, a composable head-protection method th…