نسخة أولية وصول مفتوح
Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation
Extending a text embedding model to new modalities typically degrades text retrieval quality, and existing omni-modal embedders compensate with multi-billion parameters. We present Omni-Embed-Mini, a 0.9B-parameter model that maps text, speech, audio, images, video, and visually-rich documents into a single shared cosi …