Boost Post-Training Quantization via Null Space Optimization for Large Language Models

Jiaqi Zhao, Miao Zhang, Deng Xiang +3

Existing post-training quantization methods for large language models (LLMs) offer remarkable success. However, the increasingly marginal performance gains suggest that existing qu…