schrepfler.bsky.social

schrepfler.bsky.social

@schrepfler.bsky.social

148 followers1K following230 posts

schrepfler.bsky.social reposted

The second edition of Designing Data-Intensive Applications, by myself and @chris.blue, is finished and sent off to the printers! Ebooks should be available in the next week, and print books in 3–4 weeks. Sigh of relief. 😅 (BTW, this is a good opportunity to support your favourite local bookshop!)

schrepfler.bsky.social reposted

Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.

schrepfler.bsky.social reposted

schrepfler.bsky.social reposted

Looking for a new opportunity as a VP Engineering/CTO. 14 years in iGaming, built up the engineering department and architecture for an odds making startup (Huddle Tech) spent many years building bespoke backend dealing low latency and a lot of data. #OpenToWork

schrepfler.bsky.social reposted

I'd like to build some libraries that are usable across #Java, #Scala & #Kotlin, but I also want to be free to pick my implementation language & libraries (Project Loom, Cats-Effect, Kotlin coroutines). This helps me expose nice APIs to all devs. Work in progress: github.com/funfix/tasks

github.comGitHub - funfix/tasks: Task datatype, meant for cross-language interop (Java, Kotlin, Scala)Task datatype, meant for cross-language interop (Java, Kotlin, Scala) - funfix/tasks

schrepfler.bsky.social reposted

schrepfler.bsky.social reposted

I submitted a PR that cuts average ClickBench latency by 15% for DataFusion! But reviewing it wasn't straightforward due to the nature of complex performance tuning dynamics, so I made a blog post to explain why it works -- check it out: blog.xiangpeng.systems/posts/parque...

blog.xiangpeng.systemsEfficient Filter Pushdown in Parquet – Xiangpeng’s blogHow to implement efficient filter pushdown in Parquet readers and why it’s challenging in practice.

schrepfler.bsky.social reposted

What's new in Rill 0.56? ✅API for embedded dashboards Listen for state changes and control filters from your own page ✅Query data from the CLI Write tests or run ad-hoc queries directly from the CLI ✅Upload a favicon Use a custom favicon to fully brand Rill as your own docs.rilldata.com/notes/0.56

docs.rilldata.comRill 0.56 - Favicons, API for embedded dashboards, query data from the CLI | Rill⚡ Rill Developer is a tool that makes it effortless to transform your datasets with SQL and create fast, exploratory dashboards. Rill Cloud can then help to enable shared collaboration at scale.

schrepfler.bsky.social reposted

Introducing The AI CUDA Engineer: An agentic AI system that automates the production of highly optimized CUDA kernels. sakana.ai/ai-cuda-engi... The AI CUDA Engineer can produce highly optimized CUDA kernels, reaching 10-100x speedup over common machine learning operations in PyTorch. Examples:

Gave Cline VS Code extension a go. Sweet! Access to the browser, agentic flow with Plan/Act modes are great. So far I've been a Cody fan but this one is a game changer for web dev (I implemented a test suite with 5 specs, and ~20 tests using Playwright, it took a couple of days and 3$.)

schrepfler.bsky.social reposted

schrepfler.bsky.social reposted

🧵I am happy to announce that I have just released v0.8.0 of Gatherers4j, a library of Stream Gatherers (intermediate operations) for #java 23+. Please let me know what you think, especially if you have ideas for new gatherers. github.com/tginsberg/ga...

github.comRelease Release v0.8.0 · tginsberg/gatherers4jWhat's Changed Add support for orElse() and orElseEmpty() on size-based gatherers to provide a non-exceptional output stream Implement everyNth() to get every nth element from the stream Implement...

schrepfler.bsky.social reposted

Baffling to see the disclosure around DeepSeek Last I checked the tech industry, we celebrate small teams pushing the industry forward, coming up w novel ways to build software more efficiently. And sharing it. Yet now there's a class of folks who think this is some bad thing?

schrepfler.bsky.social reposted

Let’s talk about resistance after a conqueror takes power. Specifically let’s talk about this bendy yellow building, and what it shows us about the moment the Florentine Republic finally fell to its kleptocratic/proto-capitalist banking-fortune Medici conquerors 1/?

schrepfler.bsky.social reposted

Goodfire.ai is open-sourcing Sparse Autoencoders (SAEs) for Llama 3.3 70B and Llama 3.1 8B! SAEs are interpreter models that help us understand how language models process information internally by decomposing neural activations into interpretable features.

schrepfler.bsky.social reposted

New blog post by @a13x.bsky.social: Vertical Stacking as the Relational Model Intended: UNION ALL BY NAME Alex takes us on a journey that includes a 1969 Ford Mustang, the not-too-successful SQL keyword "CORRESPONDING", and some cool DuckDB features. Read more at duckdb.org/2025/01/10/u...

duckdb.orgVertical Stacking as the Relational Model Intended: UNION ALL BY NAMEDuckDB allows vertical stacking of datasets by column name rather than position. This allows DuckDB to read files with schemas that evolve over time and finally aligns SQL with Codd's relational model...