Understanding the Weight Averaging Mechanism in LLM Training for Post-Training Quantization

Hanzhang Wang, Tianqi Shen, Zonglin Liu +3

Large language models (LLMs) are typically pretrained in high precision but increasingly deployed with low-precision post-training quantization (PTQ). Recent studies have shown tha…