EFloat: Entropy-coded Floating Point Format for Compressing Vector Embedding Models

Rajesh Bordawekar, Bulent Abali, Ming-Hung Chen

In a large class of deep learning models, including vector embedding models such as word and database embeddings, we observe that floating point exponent values cluster around a fe…