DL-QAT: Weight-Decomposed Low-Rank Quantization-Aware Training for Large Language Models

Wenjin Ke, Zhe Li, Dong Li +2

Improving the efficiency of inference in Large Language Models (LLMs) is a critical area of research. Post-training Quantization (PTQ) is a popular technique, but it often faces ch…