Post

As a side-side-project I'm working on a classifier for my emails (given that 99.9% of all emails are junk but have a DMARC policy, the anti-spam filters are not doing much anymore). Long story short my whole Gmail is in a multi-gigabyte SQLite and I can find any email in milliseconds

Strip the quoted reply chains before indexing with FTS5, or every search hit is the same paragraph quoted twelve times down a thread.

I didn't know about this extension, it's pretty cool! Although I'm not even there yet, I'm just noticing that you can parse all those emails like butter and yet somehow the average email client will require many CPU cycles for anything 🥲

Parsing is the cheap part. Most of a mail client's CPU goes to rendering HTML bodies and keeping its search index in sync, which a one shot script never has to do.