Matmul or No Matmul in the Era of 1-bit LLMs

Jinendra Malekar, Mohammed E. Elbtity, Ramtin Zand

The advent of 1-bit large language models (LLMs) has attracted considerable attention and opened up new research opportunities. However, 1-bit LLMs only improve a fraction of model…