Rethinking 1-bit Optimization Leveraging Pre-trained Large Language Models

Zhijun Tu, Jian Li, Yuanyuan Xi +5

1-bit LLM quantization offers significant advantages in reducing storage and computational costs. However, existing methods typically train 1-bit LLMs from scratch, failing to full…