SpectrumQuant: Spectrum Alignment for LLM Quantization

Dwaipayan Haldar, Indranil Patra, Azhar Yousuf +1

Orthogonal transforms have emerged as an effective tool for low-bit quantization of large language models (LLMs), as they reshape activation distributions without changing the unde…