Bi-VLM: Pushing Ultra-Low Precision Post-Training Quantization Boundaries in Vision-Language Models

Xijun Wang, Junyun Huang, Rayyan Abdalla +3

We address the critical gap between the computational demands of vision-language models and the possible ultra-low-bit weight precision (bitwidth $\le 2$ bits) we can use for highe…