Post

Hate to say it, but I might need to stop my indexer for docs.surf. It’s. Fun little project, but the costs are slowly creeping upwards as standard.site continues to grow. Tap listening to every single record just eats up way too much egress.

docs.surfDocs.surfAggregator for publications and documents on the open web

@tunji.dev

8 Apr

I'm can see how. Mine hasn't been running for a week yet and: bsky.app/profile/tunj...

TJ@tunji.dev

In under a week of indexing standard.site documents on the Heron AppView, I'm at about 1.5 million docs and most are from web.brid.gy accounts. I wonder how to handle these.

standard.siteStandard.site - One schema. Every platform.Standard.site provides shared lexicons for long-form publishing on AT Protocol. Making content easier to discover, index, and move across the ATmosphere.

Steve Simkins

@stevedylan.dev

It's rough out there fam 😅 I think if you only store valid records it helps a little bit with DB size, but doesn't stop the mass firehose of data that comes inbound.

9/4/26, 12:00 am0 reposts1 like

So much this!

~30 days uptime on my indexer, including verification traffic. 👀 I'm only getting away with it because it's running at a VPS company that doesn't care about ingress