Quantization Degradation in Large Language Models: A Signal-Noise Perspective

Chenxi Zhou, Pengfei Cao, Jinyu Ye +5

Post-training quantization reduces the deployment cost of large language models, yet how severely a quantized model degrades is not determined by bit-width alone. We systematically…