Addition is almost all you need: Compressing large language models with double binary factorization

Vladimír Boža, Vladimír Macko

Binary quantization approaches, which replace weight matrices with binary matrices and substitute costly multiplications with cheaper additions, offer a computationally efficient a…