Unifying Uniform and Binary-coding Quantization for Accurate Compression of Large Language Models

Seungcheol Park, Jeongin Bae, Beomseok Kwon +5

How can we quantize large language models while preserving accuracy? Quantization is essential for deploying large language models (LLMs) efficiently. Binary-coding quantization (B…