Achieving binary weight and activation for LLMs using Post-Training Quantization

Siqing Song, Chuang Wang, Ruiqi Wang +2

Quantizing large language models (LLMs) to 1-bit precision significantly reduces computational costs, but existing quantization techniques suffer from noticeable performance degrad…