Post

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

How does this compare to openai's embedding model? We don't have an immediate need to move off openai, but would love the flexibility ... without regressions

We haven't compared it directly, although generally OpenAI's embeddings seem to trail the better open models, so I expect it would be an improvement.

Great! Looking forward to trying this out sometime. Since we're an AWS shop we'll probably consolidate on Bedrock, and although it has an embedding service, I'd love to use that opportunity to pick something that's actually best for our needs.