Ultra-Quantisation: Efficient Embedding Search via 1.58-bit Encodings

Richard Connor, Alan Dearle, Ben Claydon

Many modern search domains comprise high-dimensional vectors of floating point numbers derived from neural networks, in the form of embeddings. Typical embeddings range in size fro…