AWEQ: Post-Training Quantization with Activation-Weight Equalization for Large Language Models

Baisong Li, Xingwang Wang, Haixiao Xu

Large language models(LLMs) exhibit excellent performance across a variety of tasks, but they come with significant computational and storage costs. Quantizing these models is an e…