Post

Matt Cockayne
@phpboyscout.uk

For a month Bytespider was the busiest AI crawler on my blog, growing fast. Then I checked Cloudflare's verified-bot field: 515 real requests, 13,573 fakes. Over half of all "AI crawler" traffic failed verification and was hunting for .env.bak and id_rsa. A user agent is just a claim.

phpboyscout.ukHalf the AI traffic was a scanner in a costumeHow a doubling AI crawler chart turned out to be vulnerability scanners wearing GPTBot and Bytespider user agents, and the one-field fix that halved the number.

0 reposts1 like

No replies yet.