This. I've thought about this a ton, and I've come to firmly believe the solution to AI scraping lies in legal, not technical, measures. Adding limitations to who can access websites undermine the fundamental principles of the open web. When you lock AI out of the web, you end up locking up the web.
Most attempts to make the web harder to scrape will also make it less accessible. Hard to prevent static analysis without also breaking screen readers
11 reposts79 likes