Continuous Approximations for Improving Quantization Aware Training of LLMs

He Li, Jianhang Hong, Yuanzhuo Wu +2

Model compression methods are used to reduce the computation and energy requirements for Large Language Models (LLMs). Quantization Aware Training (QAT), an effective model compres…