Post

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

This could be very useful for my team at our healthcare company. Thanks for your work! I see brief mention of the dataset in the paper. Can you provide more info on it? Is it proprietary? A conglomerate of a bunch of open source datasets?