Love this term "cognitive debt" as explained by Margaret Storey in margaretstorey.com/blog/2026/02... and reshared by @simonwillison.net in simonwillison.net/2026/Feb/15/... . I suppose changescape.dev is me grappling with how to hold cognitive debt at bay.
Dmitriy Ryaboy
Dmitriy Ryaboy
@squarecog.bsky.social
Works with data, runs with swords.
2.8K followers234 following244 posts
Last decade's tools are the wrong paradigm for dealing with the speed and volume of changes happening to this decade's codebases. We need a better changescape: changescape.dev
Sigh. So what actually moved the needle was fixing their cdc and not writing so many updates to the upstream in the first place. Which probably would've made BQ work just fine too. It's so often not the migration but the rearchtecture it forces. www.bolna.ai/blog/bigquer...
Dmitriy Ryaboy reposted
Write about how software engineering is changing inside your company / team / project. Don’t use AI. Win $10K and get published in The Pragmatic Engineer. You have a month: submit by 4 October. Details: blog.pragmaticengineer.com/how-software...
@phokion.bsky.social just finished Whalesong. Excellent as always! The wait for #4 begins.
I knew SQLGlot is a solid sql parser, but it wasn't till I started working on dblect that I learned how powerful it is. medium.com/@squarecog/t...
dblect 0.1.0 released! Test your dbt workflows and find hidden dangers that linting and unit testing alone won't warn you about. Pypi: pypi.org/project/dble... . Github: github.com/dvryaboy/dbl... Intro blog: medium.com/@squarecog/t...
I'm getting pretty close to the 0.1.0 release of dblect. If you are into the whole actually testing your dbt workflows thing, check out the README: github.com/dvryaboy/dbl...
OMG my baby tool `dblect` is actually somewhat useful, check this out @matsonj.com : github.com/matsonj/nba-...
Hypothesis is catching such beautiful and weird edge cases. Saving me a lot of future embarrassment. Thanks @drmaciver.bsky.social and the rest of the team!
This is a pretty intriguing idea for future proofing file formats. It does assume wasm is future proof, of course, but that feels like a safer bet than "assume readers are updated"
Our F3 files embed small WASM programs to decode data. If somebody creates a new encoding and the DBMS does not have native impl, it can still read data using WASM passing Arrow buffers. Our experiments show WASM is 15-20% slower than native. We use @spiraldb.com's Vortex encoding impls.
If you love this sort of thing, read up on C-store, which introduced this idea in 2005 and commercialized it in Vertica. Stonebraker, Sam Madden, Daniel Abadi. Parquet was also partially inspired by Vertica (and Google's Dremel, and PaX by Natassa Ailamaki et al) :-).
Are you streaming into your Lakehouse? Traditional formats suffered with the “many small files” problem — OLAP engines merge them reactively with long jobs. ⏳ DuckLake takes a proactive path: Data Inlining + async flush to parquet while always keeping data queryable ⚡