Post

Newsrooms should not block the Internet Archive. Any public service publisher should not block the Internet Archive. If anything, we should all be directly supporting the Internet Archive.

I am annoyed that it keeps getting brought up as an “AI scraping” issue when it’s clearly a greedy paywall thing

It’s really not. It’s motivated by AI scraping from the folks I’ve spoken with

Could news sites use a “sign up/sign in to read” to block AI scrapers (as I’ve seen some have) instead of taking stuff off of internet archive? I’m just curious, I’m not a tech person rlly

i believe the issue is that AI scrapers are crawling the Internet Archive. The NYT can try to block AI scrapers from their own site, but they can’t force the Archive to block AI scrapers from accessing archived NYT content