Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings

Egor Kolodin, Egor Krasnoperov, Evgeniy Kosarev +1

We introduce Giga-Embeddings, a family of text embedding models designed to combine strong retrieval quality with efficient serving. Its largest member is a sparse 10B-parameter Mi…