Post

Hate to say it, but I might need to stop my indexer for docs.surf. It’s. Fun little project, but the costs are slowly creeping upwards as standard.site continues to grow. Tap listening to every single record just eats up way too much egress.

with tap bandwidth do you mean ingress or egress? the full firehose does add up to a lot of ingress every month, but that is no-cost with many hosting providers. in theory you could split out just the tap part to one of those, and keep the rest of your setup where it is

That’s kinda where I ended up. I’m currently running tap on railway and sending webhooks to Cloudflare to handle data processing, but since it’s getting so many records it’s pushing egress costs up.

Have you looked at Durable Objects on Cloudflare for listening? It shouldn't cost too much to listen to the Jetstream from there. Ingress and egress are free. You just pay for the DO minutes, which would be within the free tier.