Foundations of Large Language Model Compression -- Part 1: Weight Quantization

Sean I. Young

In recent years, compression of large language models (LLMs) has emerged as an important problem to enable language model deployment on resource-constrained devices, reduce computa…