Post

All uses of AI are costing someone… this sucks as the Game UI database is such a valuable resource.

2K reposts5.5K likes

What pisses me off about AI apologists is that they always are like "AI art got way better" and "Chat answers are getting more reliable", they never think about what AI does behind the scenes.

And it's not even true, it's still the case that any time I try letting AI answer my searches for information when I'm googling it ends up in a conversation that's kinda "no, 2+2 = 4, not 5" "You're right! I done a booboo, 2+2 is indeed 4!" And it required me to have enough knowledge to spot it.

First I've heard of the Game UI Database, and it looks amazing! Too bad I only learned about it in the context of it being suffocated by AI scrapers. 😭

kinda of wild to watch all the money in the world being spent to destroy the internet in realtime, punishing anyone who has contributed to it. even if we stop them, i am already pretty messed up about it

i know this is a serious post, and i shall not downplay the amount this sucks, but i cant be the only one that sees the comedy in using a Ratman pfp whilst posting anti ai, cause like, he would

We have that, there are a few pieces of software that can detect whether a request is probably from an AI scraper and serve it a labyrinth of nonsense pages. One of them is called iocaine.

Its kinda hard to consider every angle of the damage caused by generative AI either through scraping or the generation itself. Theres just so many, nobody can be faulted for forgetting or not even knowing certain aspects of it all.

I'd be way less concerned if they were actually good at scraping websites. Hitting wiki sites is especially egregious, since a ton of them have archives you can grab all at once rather than hitting rendered pages every few seconds in perpetuity.

These guys are all "it's "public data" so it's fair game, but publishing something on the internet is not consent for commercial use! The default is "it's copyrighted." My site's been scraped thousands of times, and there's no way they're respecting the actual license I publish my drawings under.

Around the start of 2025, scrapers for LLM bots would be hitting my site so hard the (small) webhost would shut down (so not only my site, but about 100 other sites would go down.) - it'd reset on the hour if it was down, and the typical uptime was less than 30s before it shut down again.

Now the "solution" to this is to pay cloudflare for a service that directs bots away from the site, and that service costs more than twice as much as my hosting does - but without it, I can't have a website online with a small host. It'd force everyone onto the big providers' infrastructure.

Yeah sorry for using your linkedin post as that's where I saw it - posted and then thought... wait, I wonder if Edd is here.. sigh... And now I was told you also make cool music!?!?! Will be checking that out later!

yeah i run a dinky niche web app, and in the last year, random nonsense hits against the API went from a few thousand a month to many, many millions per month. It's a huge strain, hurting both me and my users, and benefitting no one. I'm sure it's even worse for sites with actual popular content.

This has little to do with LLMs and everything to do with a lack of systemic consequences for using large computing power. We've been in an age where someone for very little money can buy time on giant networks and just ddos someone with no repercussions.

Just went to the website and it is still in "database unavailable" state. At this rate, the behavior of the crawler is no difference than a DDoS attack and should be illegal.

I wonder if requiring a sign in to see the content would help at least reduce the impact? along with blocking IP pools allocated to the companies running these things. Extra ball ache to set-up, but I'd not object to having to sign in to see the UI Database it's super useful

Our University has to deal with repeated turn aways from our subsribed databases because it gets detected as bots and AI scraping. It's real world research and teaching being fucked in real time by techbro bullshit

Captcha challenges for anything even suspected of being a bot, it’s the only way to run public websites now. Let them come to you for an exception and agreed rate limit for their scraping.

Google at least used to do lightweight crawls, would've been massively complex to make search work. These crawlers OTOH behave like DDoS attacks and should be penalized with having their data centers seized and destroyed

This one in particular sadly isn't new. If you've got a service accessible over the web it's been hammered by bots looking for exploits for decades.

It's so stupid, too. They could at least try to cache it or something instead of requesting it over and over??? I doubt the people doing it even know how to program.

we had that issue at work, so we took a single, drastic measure: ban a majority of AWS IPs from connecting shut them out, abort all their traffic - if it doesn't reach the server or gets ignored by it they can't do shit also maybe mail the abuse address for that IP

I didn't even consider this was a thing to do, but found a repo that just has a huge list of IP addresses from data centers to block. Need to set this myself.