Post

Are you using open models on a regular basis? If yes, I’d love to hear about it! - what’s your use-case? - local or through an inference provider? - how has the experience evolved over time? - anything you miss from the closed models, if you’ve used them? Would appreciate reposts for visibility 🙏

I have mostly abandoned thinking models for loops and supervisors. I use a fair amount of obsidian (basic features, mostly just markdown, webclipper, and quickadd). Having a couple of goose recipes/Pydantic AI agents to go parse through todo and reminders to take care of my pets is the most basic.

For actual work, I use GLM at the moment to go through and build grpc connectors, write documentation, and create diagrams with the mermaid MCP. Mostly not necessarily to write the code but to improve code quality. And embeddings. Lots of local vector search/hybrid search.

My eventual end goal here is to replace platform offerings (ie: Claude) with a multi model pipeline of tools and structured outputs. This is the exact same thing any developer did when learning monolith bad, microservices good.