Post

What is the deal with everyone's bots. This is a brand new project (a few weeks ago) and they've literally crawled the whole thing and cost me > $100 in compute/memory in a few weeks. I want to allow searches but this feels like training data...

It’s bonkers. One of our client sites has been serving 90% bot traffic the last few months 😥