Giga-Embeddings: a sparse 10B-parameter Mixture-of-Experts encoder achieves the strongest aggregate performance across English, Russian, multilingual, and code benchmarks in the family.
Read the original at arxiv.org→arXiv:2608.23806v1 Announce Type: new Abstract: We introduce Giga-Embeddings, a family of text embedding models designed to combine strong retrieval quality with efficient serving. Its largest member is a sparse...
Original headline: "Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings"
Coverage timeline
- Aug 26, 04:00 UTC arXiv cs.CL lead source Giga-Embeddings: Mixture-of-Experts Encoders for High-Throughput Text Embeddings