Vini

motherduck.comDifferential Storage: A Key Building Block For A DuckDB-Based Data Warehouse - MotherDuck BlogDifferential Storage: A Key Building Block For A DuckDB-Based Data Warehouse | Reading time: 11 min read

I love databases.

Today is Play Day for me and I've started building a Differential Storage using GoLang, something similar to what @motherduck.com does under the hood: motherduck.com/blog/differe...

Had some progress today! I could write to a “virtual” file backed by Postgres. Since I’m using FUSE to simulate my file system ops, the file content is being persisted into Postgres instead of my OS file system 🎉

24 Mar 2025

Well, it's now backed by S3 and I've made the code public for anyone interested: github.com/vinimdocarmo... 🦆

github.comGitHub - vinimdocarmo/quackfs: FUSE-based DuckDB file system 🦆FUSE-based DuckDB file system 🦆. Contribute to vinimdocarmo/quackfs development by creating an account on GitHub.

24 Mar 2025

Went down on a storage rabbit role in the past weeks 😁 github.com/vinimdocarmo...

3 Nov 2024

Sharing some personal notes on the max-heap data structure commonly used for implementing priority queues. I might keep sharing these kind of notes here in case it helps someone else.

3 Nov 2024

If a node is breaking the heap property push it down by swapping places with smaller children recursively.

18 Mar 2025

What if you have an array and you want to transform it into a max-heap? Here you go:

6 Mar 2025

I was solving a DP LeetCode problem in Python and I really wanted to visualize my decision tree structure in the terminal. I'm not a Python expert nor I wanted to waste my energy implementing a "pretty print" function. Copilot was disabled, but I turned it on and did what one must (ask the AI):

6 Mar 2025

That's usually how I like to use AI for coding: to do things I don't want to do myself. Letting it do (i.e. to try to) everything is really unrewarding for me 🫠 I keep the resiliency high and still try and experiment with LLMs quite often though

6 Mar 2025

Here's the AI generated implementation by the way: gist.github.com/vinimdocarmo...

My attention span is pretty short and every time Copilot takes much time to "think" I lose interest. I'm not finding working with AI much rewarding when it comes to coding. Maybe I should do some changes on my workflow? Not sure. I'll keep trying.

I mind less when it gives the precise, correct answer. But it's even more frustrating when it just spits nonsense.

Today is Play Day for me and I've started building a Differential Storage using GoLang, something similar to what @motherduck.com does under the hood: motherduck.com/blog/differe...

I didn't want to setup my Mac machine to make FUSE work, so I've decided to setup a dev container for VS Code and that's been giving me some headaches. Almost finished though. I only need to finish setting up Postgres 🤞

Vini reposted

Kay Lack

@neoeno.bsky.social

15 Jan 2025

new video! this datatype → [1, 2, 3] ← is a bit of a marvel. it can store items of any size, grow to any length, rarely causes performance issues, and almost every modern language has one. what is it, really? and how does it work?

In October I interviewed for a big tech company. I passed all the interview stages, but in the end they decided to hire someone else with more experience. That sucked big time

I passed the interviews, but unfortunately they couldn’t hire me in Amsterdam anymore due to policy changes. They still tried and I was aware London would be the second option. The offer turned out to be London-based and after much deliberation with my partner we decided to stay in Amsterdam.

6 Feb 2025

Even though the position and company was a great fit, I put my and my partner’s needs and long-term goals in first place. I’m relieved but at the same time I feel a bit of grief.

In October I interviewed for a big tech company. I passed all the interview stages, but in the end they decided to hire someone else with more experience. That sucked big time

I was way more in ease in the second interview process. The first time I created so much expectations and it led to big frustration in the end. I'm glad I didn't give up though. Regardless of how it'll pan out, I've learned a lot!

7 Jan 2025

I’ve passed to final stage: a 30min call with an Executive. That’s one stage further compared to last time, so that’s a win already 🥳 Godspeed 🤞

en.cppreference.comUser-defined literals (since C++11) - cppreference.com

1 Jan 2025

Today I saw this expression for the first time while learning C++ `std::this_thread::sleep_for(200ms);`. I was suspicious. How is `200ms` defined? Is that dynamic? What?! 💡 TIL: you can define your own literals en.cppreference.com/w/cpp/langua...

Vini reposted

Loris Cro ⚡

@kristoff.it

27 Dec 2024

Ghostty is out of private beta! #ziglang ghostty.org

ghostty.orgGhosttyGhostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.

25 Dec 2024

That’s how I best learn things 🎨

17 Dec 2024

I'm mentoring a good friend of mine - which also happened to be my manager and CEO of a startup I worked for - and we experienced some real, weird bugs using node modules and git locally! I've never experienced those myself, so it was really hard to find out what was going on 👻

He uses a MacBook and his projects folder was being synced with iCloud Drive. So every time any file was changed, iCloud Drive sync'ed them with remote. Problem is, `.git` and `node_modules` folders change quite often and iCloud Drive started to loose some files between changes. What a nightmare!

17 Dec 2024

Well, we didn't spend time confirming that iCloud Drive was loosing files, so that's still an assumption. But getting that folder out of iCloud Drive sync stopped the issue 🤷‍♂️

It was a simple React app, but often times the git history and remote config would just go crazy. npm start would also just stop working with some weird timeout errors reading files. It was like this for weeks, until I noticed something funny...

In October I interviewed for a big tech company. I passed all the interview stages, but in the end they decided to hire someone else with more experience. That sucked big time

4 days later I saw another interesting position for another unrelated team. Applied again, joined the process and last week I did the last round of interviews. I'm now waiting on their final decision. Hope it's a better one this time 🤞

duckdb.orgDuckCon #6 in AmsterdamDuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...

3 Dec 2024

What if you have an array and you want to transform it into a max-head? I’ll soon share that too!

Vini@vinimdocarmo.com

If a node is breaking the heap property push it down by swapping places with smaller children recursively.

max-heap* 🙃

A @duckdb.org Conference in Amsterdam?! I'm definitely going 🦆🌷 duckdb.org/events/2025/...

TIL: window functions work in ORDER BY! Pretty useful for complex sorting. Check this out

timescale.comHow We Designed a Resilient Vector Embedding Creation System for PostgreSQL DataLearn the design decisions and trade-offs behind our system for creating and storing vector embeddings for data in PostgreSQL, PgVectorizer.

It sorts employees by department, then salary, then hire date within each department

We got a dog 💜

I've just learned that pgai 🐘 (vectorizer) by TimescaleDB implements its queue using a db table. Blog post here: www.timescale.com/blog/how-we-...

4 years ago I decided to focus my career on backend development instead of fullstack development. While working at WeTransfer I'm made my name when it comes to databases (specially MySQL which is what we use).

In various projects I had to go a bit lower down the stack to help us improve our storage workloads. I've always liked databases, but now I'm just loving it to a point where I decided to move my career to this area of expertise.