Post

Tom Aarsen@tomaarsen.com

🏎️ I've never seen MoE models for embedding & search this small: 1.5M, 27M & 115M parameters! VAGO Solutions' MoEdernColBERT models take on much larger dense retrievers, with 115M near or ahead of Qwen3-Embedding-0.6B in their overview at 8× the encoding throughput. Details 🧵