BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models

Liulu He, Shenli Zheng, Karwei Sun +6

Rotations have become essential to state-of-the-art quantization pipelines for large language models (LLMs) by effectively smoothing outliers in weights and activations. However, f…