Inner Product Aware Quantization: Provably Fast, Accurate, and Adaptive Algorithms

Nathan White, Krish Singal

Quantization is a fundamental tool used to compress datasets, neural network weights, and memory usage in a range of computational tasks. Many downstream applications of vector qua…