Showing 2026Show all
2 papers · 1 filter
math.OC2026
Beyond Shadow Weights: Quantization-Aware Training as Quantized-Endpoint Descent
Sheng-An Xu, Hanyang Li, Jianhao Ma +1
Quantization-aware training (QAT) updates a full-precision shadow weight but deploys the quantized endpoint . Existing explanations for QAT largely view…
cs.LG2026
Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin
Hanyang Li, Jianhao Ma, Ying Cui
Post-training quantization (PTQ) converts a trained full-precision model into low-bit weights without task-level retraining, while quantization-aware training (QAT) incorporates qu…