Post

If you like a live scrolling list of Bluesky posts from around the world, here is something for you. I've just shipped an update to my open source ATProto Browser that shows a live feed of Bluesky posts from the firehose. Try it and let me know what you think! atproto-browser.haroldadmin.com

Kshitij

@haroldadmin.com

5 Dec 2024

While this might look similar to Firesky.tv, the technical implementation is very different. ATProto Browser uses a fully client-side feed built on top of Bluesky's Jetstream project - no polling required! More details in 🧵

firesky.tvFireskyWatch every Bluesky post in real-time – filter the firehose

Kshitij

@haroldadmin.com

5 Dec 2024

Jetstream's Web Socket API emits hundreds of updates every second -- enough to overwhelm the browser if not managed carefully. Unfortunately, there is no standard way to solve backpressure in Web Sockets on the browser. The feed solves this by using a Web Streams layer.

Kshitij

@haroldadmin.com

The pipeline roughly looks like this: Web Socket -> Readable Stream -> Transforms -> Writable Stream. This lets me use the built-in backpressure support in web streams, but I also sample incoming updates to keep things running smoothly.

5/12/24, 11:11 pm0 reposts1 like

Kshitij

@haroldadmin.com

5 Dec 2024

At the end of the pipeline is a Writable Stream, which is just fake wrapper around something that a React component can subscribe to. The Feed component takes care of buffering the latest posts in memory, and discards the rest. GC is great, isn't it?

Kshitij

@haroldadmin.com

5 Dec 2024

I might add support for specifying a custom sampling rate in the future, as well as increasing the number of posts buffered in memory. In the meantime, feel free to look around the code on Github github.com/haroldadmin/...

github.comGitHub - haroldadmin/atproto-browser: Browser for files stored on the ATProto networkBrowser for files stored on the ATProto network. Contribute to haroldadmin/atproto-browser development by creating an account on GitHub.