PhaseQuant: Mitigating Activation Quantization Collapse via Residual-Stream Dynamics

Zimo Zhao, Maolin Wang, Bowen Yu +3

Post-training quantization (PTQ) is essential for efficient large language model (LLM) inference, but reliably quantizing activations remains challenging when weights, activations,…