On the Expressive Power of Weight Quantization in Large Language Models

Shao-Qun Zhang

In recent years, weight quantization that encodes the learnable parameters of large language models in an $n$-bit format has garnered significant attention due to its potential for…