centrix

S3Mirror is an open source application for transferring large genomic datasets b/t S3 buckets efficiently, reliably, & with full observability. Built on DBOS Transact, it was created to meet the needs of a pharmaceutical organization handling clinical trial data. www.biorxiv.org/content/10.1...

I'm trying to get into the habit of producing more video, so on the spur of the moment I made a 7 minute video showing how I used Claude Code to put together a simple GitHub Actions workflow www.youtube.com/watch?v=VC6d...

More context, more problems. www.dbreunig.com/2025/06/22/h...

I think "context engineering" is going to stick - unlike "prompt engineering" it has an inferred definition that's much closer to the intended meaning, which is to carefully and skillfully construct the right context to get great results from LLMs simonwillison.net/2025/Jun/27/...

My notes on Gemini CLI, including poking around in their system prompt which I've extracted into a more readable rendered Gist simonwillison.net/2025/Jun/25/...

As I'm evaluating XML output I keep running into invalid XML slop. So now I'm parsing AI XML slop with an AI generated XML slop parser. This library is 100% Claude generated. github.com/mitsuhiko/sl...

Ditto is probably the most mature sync engine out there used in airlines and other critical environments. Loved this conversation with Adam who’s the founder of Ditto and previously built Realm. Lots of great stories and insights in this episode!

Here's video, slides and a detailed annotated transcript from my talk at this week's AI Engineer World's Fair conference in San Francisco - "The last year six months in LLMs, illustrated by pelicans on bicycles" simonwillison.net/2025/Jun/6/s...

Build collaborative applications with CRDTs straight outta Postgres using the new Yjs Electric provider. 🧵 www.npmjs.com/package/@ele...

Introducing LiveStore (beta) LiveStore is a next-generation state management framework based on reactive SQLite and built-in sync engine. livestore.dev

After 4 years of work, I'm incredibly excited to introduce LiveStore, the next-gen data layer I'm building for Overtone. It's based on reactive SQLite and has a built-in sync engine. Give it a try - would love your feedback!

Shopify Polaris is now built on web components. My team and I have been working on this for a while and it's been a lot of fun to "embrace the platform"! shopify.dev/beta/next-ge... Lots of things learned, lots of fun edge cases discovered (hello moving web components to iFrames in Firefox)

Hey look! I've been working on a thing! It's a statically typed, JIT compiled, hot-reloadable, embedded scripting language. blog.nlnetlabs.nl/introducing-...

Pinoutleaf: Simplifying Pinout References

With workflows stored in Postgres, you can: - Query failed billing workflows - Identify affected customers - Fork workflows to create new ones starting from the failed step Learn more 👇🏽 www.dbos.dev/blog/why-wor...

Need a weekend challenge? Igor Konnov sets out to specify the Two-Phase Commit Protocol — using nothing less than the Lean Theorem Prover Modeling distributed protocols has never looked so formal. protocols-made-fun.com/lean/2025/04...

Announcing Datasette for Newsrooms - a hosted version of @datasette.io specifically targeted at newsrooms and data journalists Think of it as a library for your data - load in CSVs and JSON, extract data with LLMs, collaborate on analysis with the rest of your team simonwillison.net/2025/Apr/24/...

New blog post on the mental model I've used when working through complex or confusing papers on transactional systems. transactional.blog/b...

@taran.space and more friendly folks ARK Builders wrote an article about me, comparing me with alternatives like libp2p, SyncThing and Nebula: ark-builders.medium.com/the-deceptiv... Thank you for the kind words :)

Graft is a really interesting new open source replication system designed for read-write multi-leader replication, with a SQLite extension as the first demonstration of what it can do simonwillison.net/2025/Apr/8/s...

Planet Postgres: notso.boringsql.com/posts/know-t... Fantastic article all about timestamps, intervals, and other time-related gotchas. #postgres #planetpg #postgresql (tl;dr always use timestamptz, never timestamp)

A few days ago I gave a keynote at the PaPoC workshop on Byzantine Eventual Consistency and Local-first Access Control. It wasn't recorded, but slides are here speakerdeck.com/ept/byzantin...

This might be the most incredible software library landing page I’ve ever seen. Totally blown away.

Excited to share this blogpost with y'all! expertofobsolescence.substack.com/p/the-hard-t...

Ever wanted to build a custom embedded device but felt stuck with off-the-shelf boards? Meet Trellis! 🌱 A Nerves-first, open-source hardware platform that gives you a solid starting point for your custom hardware projects I'm beyond excited to speak about it at @elixirconf.bsky.social EU in May!

Running DBOS at scale just got way easier. Introducing Conductor, a managed service that helps you operate self-hosted @dbos.dev applications in production across your infrastructure or any cloud. Imagine distributed workflow recovery, observability, and queue management. 🧵

🥳Latest free eBook is a deep dive on @cilium.io network policy engine available now!🔥 > Label-Based Security Identities > Multi-Tenancy & Policy Scoping > Real-World Policy Implementations > Scaling and Observability > Advanced Security Strategies isovalent.com/blog/post/ci... #Kubernetes #ebpf

We're hosting another virtual meetup! Come ask questions, get help, and see what others are building with @dbos.dev Learn how to: ▪️ Self-host durable apps with DBOS Transact ▪️ Monitor your DBOS apps using Datadog 👇🏼 RSVP lu.ma/t5o4wz6s 🗓️ Thu, April 3 | 2PM EST

New release of shot-scraper with the ability to conveniently run scripts shared on GitHub against web pages in a headless browser simonwillison.net/2025/Mar/25/...

Playwright (the browser automation tool) has a neat new MCP server which lets the Claude Desktop app drive a local headless browser via the chrome accessibility tree simonwillison.net/2025/Mar/25/...

In this Lightning Talk with Daneyon Hansen we will introduce the LLM Instance Gateway and talk about why it's important for optimal LLMs serving 🙌 Join us on April 1st at the hashtag#CNK8sAIDay Europe at the ExCel London at 10:00AM BST 👇 lnkd.in/eeY-hXZw #GenAI #LLMs #AI #Kubernetes #DevRel

🎨 The BKMN Collection Day 5: Swipe actions We've saved the most complex for last. This example combines animate, motion values, useSpring and useTransform to create this slide-to-reveal actions UI. Full source and tutorial: examples.motion.dev/react/swipe-...

My roadmap for becoming 1.0 versions old includes removing as much non-IETF/unusual networking tricks that aren't strictly necessary anymore. In the latest release: We're removing the self-signed certificate tricks and replace them with the raw public key RFC 7250 🙌 www.iroh.computer/blog/iroh-0-...

The BKMN Collection Day 1: Notification stack This iOS-inspired notifications stack uses Motion's variants to gracefully animate between open and closed states with finely-tuned physics-based springs. JS: examples.motion.dev/js/notificat... React: examples.motion.dev/react/notifi...

It's an exciting day for @electric-sql.com - we've published v1 of our sync engine 🎉🚀 It's been a lot of work from an awesome team, that I'm so proud to be part of, to get here! The API is stable, and has been running at scale in production for a few months 🥳

Electric is now in GA! 🚀 Check out the 1.0 release post here: electric-sql.com/blog/2025/03... The APIs are stable and we're is ready for mission critical, production apps. Super excited to see what you build with Electric now it's hit 1.0!

Coding with AI? LLMs help with the first 70% of grunt work, but human skills remain critical for that last 30%: system design, maintainability & more. I cover this in my new article "Maximizing the human 30% of AI-assisted coding": ✍️ bit.ly/ai-coding-30

If you don't know about these you should know about these www.builder-blueprints.com/library

📣 Extremely excited to have collaborated with BKMN on a new Motion Examples collection. He's one of my favourite microinteraction designers and a long-time Motion boss. We're going to release a new example every day next week, here's a sneak peak:

End-to-end encrypted calls over iroh via RTP-over-QUIC? Video streaming over iroh using gstreamer? @frando.bsky.social and @dig.bsky.social have been cooking up some experiments recently: www.youtube.com/watch?v=K3qq...

If you want to send around big or small chunks of content-addressed data, iroh-blobs is there for you. We've poured quite a bit of engineering work into making it fast! Today, we're writing about how we designed blob storage especially on the Filesystem: www.iroh.computer/blog/blob-st...

Here's the table of contents for my lengthy new piece on how I use LLMs to help me write code simonwillison.net/2025/Mar/11/...

speaking at this tonight if you're in NYC & want to come thru: www.meetup.com/rust-nyc/eve...

Chapters 1–7 of the second edition of Designing Data-Intensive Applications are now available in early release (sorry, O'Reilly subscribers only at this point). Among other changes, you may notice that we now talk about “sharding” rather than “partitioning” www.oreilly.com/library/view...

I saw lots of chatter about MCP servers on X this weekend. They effectively let you "extend" Cursor with custom tools. I found a lot of examples for them in Python but not so many in Go... so I made one.