Benford's Law as a Distributional Prior for Post-Training Quantization of Large Language Models

Arthur Negrão, Pedro Silva, Vander L. S. Freitas +2

Post-training quantization (PTQ) is a practical way to reduce the memory footprint of large language models, but low-bit quantization is sensitive to mismatches between the quantiz…