Qrazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring

Dongyoung Lee, Seungkyu Choi, Ik Joon Chang

Large-scale language models (LLMs) excel in language processing tasks but face deployment challenges due to high memory and computational demands. While low-bit quantization, such…