When are 1.58 bits enough? A Bottom-up Exploration of BitNet Quantization

Jacob Nielsen, Lukas Galke, Peter Schneider-Kamp

Contemporary machine learning models, such as language models, are powerful, but come with immense resource requirements both at training and inference time. It has been shown that…