REAL-Q: E2E LLM Quantization via Dynamic Gradient Descent

Qian Zhang, Yaoming Li, Zhewen Tan +9

Post-training quantization (PTQ) is essential for deploying large language models (LLMs) under strict resource constraints. State-of-the-art PTQ methods quantize each layer with a…