Price of metric universality in vector quantization is at most 0.11 bit

Alina Harbuzova, Or Ordentlich, Yury Polyanskiy

Fast computation of a matrix product $W^{\top }X$ is a workhorse of modern LLMs. To make their deployment more efficient, a popular approach is that of using a low-precision approxim…