Post

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

Ooh! This looks very promising. I’ve been thinking of replacing some classification steps in a workflow with local models. I’m curious how fast they can be on CPU only hardware(compared to slow sonnet api calls).