Breaking Modality Heterogeneity in Low-Bit Quantization for Large Vision-Language Models

Yi Zhong, Haotong Qin, Xindong Zhang +2

Low-bit post-training quantization (PTQ) is a pivotal technique for deploying Vision-Language Models (VLMs) on resource-constrained devices. However, existing PTQ methods often deg…