SEPTQ: A Simple and Effective Post-Training Quantization Paradigm for Large Language Models

Han Liu, Haotian Gao, Xiaotong Zhang +5

Large language models (LLMs) have shown remarkable performance in various domains, but they are constrained by massive computational and storage costs. Quantization, an effective t…