Accelerating Sparse Ternary GEMM for Quantized ML on Apple Silicon

Baraq Lipshitz, Alessio Melone, Charalampos Maraziaris +1

Sparse Ternary General Matrix-Matrix Multiplication (GEMM) remains under-optimized in existing libraries for Apple Silicon CPUs. We present a Sparse Ternary GEMM kernel optimized s…