EmbeddingGemma-2 (577M) reaches MAEB audio #1 on MTEB by adding a 2.4 MB PCA head with zero training, moving from rank #26 to #1.
Read the original at www.reddit.com→Model & weights: BrunoHays/embeddinggemma-2-nullspace-audio MAEB (Massive Audio Embedding Benchmark) is the main MTEB leaderboard benchmark for audio and text-to-audio embeddings, currently dominated by 8B-9B...
Original headline: "I took EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MTEB Audio leaderboard (MAEB), beating 9B models by adding a 2.4 MB PCA head with zero training"
Coverage timeline
- Oct 28, 13:23 UTC r/LocalLLaMA lead source I took EmbeddingGemma-2 (577M) from Rank #26 to #1 on the MTEB Audio leaderboard (MAEB), beating 9B models by adding a 2.4 MB PCA head with zero training