Post

are handles verified?

Questions after reading the introduction: Is TAP a mirroring tool? Does it keep all the data about the repos that you asked it for in its own database? Should you query that database directly or does it have a query API?

Hey, some first questions: - "id" is like seq in the firehose, right? (incrementing by 1?) - is there something like a "cursor" at all, I mean for the Tap, i.e. connecting to /channel passing the cursor of how far you got before disconnecting last time?

- do I understand correctly that this is meant to have basically a single consumer (as opposed to jetstream having consumers processing copies of the same stream), so things like acks are tracked globally, not per connection?

yeah exactly single consumer. if you connect more than one consumer, it will transparently shard the output

- does the acks mode mean that the service sends one event and then waits until it gets an ack in response before sending another? or that it streams them normally, but if they aren't acked at whatever point later, they will be re-sent on next connect?

Looks cool! 👀 So this is basically meant to make it easier to build new apps like e.g. Leaflet (and possibly a full bsky AppView too), so you can let it handle some of the boilerplatey streaming/syncing work you'd need to otherwise do yourself, right?

yup exactly! and especially if there's already data out in the network that you need to backfill

Wait... It got *all of it*?!

Just how many terabytes for a full sync are we talking about here? Asking for a mate who definitely isn’t even thinking about a full sync, for the lols, maybe.

in depends what type of database you're putting it in & what sort of indexes you have on it. i'd estimate ~10TB

tap link goes to indigo repo, is that expected? i can never find my way around that repo

its here github.com/bluesky-soci...

ah ok. honestly always found that repo layout confusing. i would never think to look for packages inside something called “cmd”. is that a Go convention? it’s nice there’s at least links from README into individual packages. need to add tap there so others can find it

is this building towards Sync1.1? this looks awesome

this is a fully sync1.1 compliant sync consumer 👌

So Tap implements things that aren’t described within the statusphere example, yeah? Any plans to update or include a separate example that uses Tap? Asking because of my current endeavor to actually learn things 🙃

yes totally! we want to revamp the statusphere example with Tap & the new lexicon SDK

I've been playing with this for a week or so and it's really nice! saved a lot of time. only q from me is if there's any possibility of support for using multiple signal collections?