I built a Bluesky post backlink index for @shelf.cafe and wrote up all the juicy technical details. Features kite+jetstream, @microcosm.blue's constellation, and amazingly, bloom filters! One of the most fun blog posts I've written. jola.dev/posts/buildi...
Post
jola.devMaking your own atproto backlink indexI built an atproto backlink index using Latch for primitives and Kite for the jetstream, and I sped it up with some neat bloom filter and erlang atomics action.
Thanks great read! How ressource hungry is that? For low traffic apps it's pretty easy to make a very low cost appview, but I still use Constellation for backlinks on askimut.at because I didn't felt like listening to the whole network (or all of bsky posts). But maybe I'm wrong?
askimut.atAskimut
No noticeable impact on CPU usage on my 8 CPU server when I added this. Even if I removed the collection filter it would keep up just fine at peak with one process, based on the rough estimates I did at the time, although I didn't write any numbers down
0 reposts2 likes