Post

Newsrooms should not block the Internet Archive. Any public service publisher should not block the Internet Archive. If anything, we should all be directly supporting the Internet Archive.

I am annoyed that it keeps getting brought up as an “AI scraping” issue when it’s clearly a greedy paywall thing

It’s really not. It’s motivated by AI scraping from the folks I’ve spoken with

Why not use bot blockers and have internet archive as an exception

And my info may be dated but trying to block just bots is a challenge in itself

There’s this it works by making the computer do math or something so it makes scrapping via bots expensive it’s being used funnily enough even if it looks like that by UN websites and libraries. But I can see that the problem is a different issue.