Preprint Open access
Quantize by Drift: Label-Free Mixed-Precision Post-Training Quantization for Text Embedders
Mixed-precision post-training quantization needs a per-module sensitivity signal; for a text embedder the obvious one -- the retrieval quality a module costs when quantized -- needs relevance labels that deployments rarely have. We measure a label-free substitute: quantization-induced representation drift, obtained by …