Quantize by Drift: Label-Free Mixed-Precision Post-Training Quantization for Text Embedders

Hyojung Han, Jongmin Kim, Seung-Hun Jeon

Mixed-precision post-training quantization needs a per-module sensitivity signal; for a text embedder the obvious one -- the retrieval quality a module costs when quantized -- need…