New: Unsealed court docs detail Big Tech’s yearslong, secret race to ingest the collective works of humanity, including Anthropic’s project to “destructively scan all the books in the world.” Gift link: wapo.st/4rjXAMQ
Post
Anthropic hired the former head of Google Books to oversee its secret "Project Panama," new court docs show — quietly buying millions of used books in bulk, breaking their spines and scanning them to feed into its Claude chatbot. wapo.st/4rjXAMQ
58 reposts132 likes
It is absolutely possible to digitize a book without destroying it. @archive.org does not destroy the books it images.
that's not true though? archive.org will very often destructively scan things, especially when they are building the OCR friendly edition for screen readers and they absolutely need the higher quality scans. they stream it, it's fun background noise
Would love your source on this. I’ve been to the IA and seen the tools they use. Their core device is the Scribe Workstation, a cradle with suspended cameras that shoot each page (digitization.archive.org/digitization/). It may be slower than other methods but it is indeed the method they use.
Anthropic's project to "destructively scan all the books in the world" was actually viewed as the *more* ethical and legally sound approach to training its AI. Previously the industry standard had been simply to pirate vast "shadow libraries" of digitized books for free online. wapo.st/4rjXAMQ
Props to @ashleybelanger.bsky.social at Ars Technica, Ernesto Van der Sar at Torrent Freak, @alexreisner.bsky.social for The Atlantic and others who have done excellent previous reporting on Big Tech's race to ingest the world's books.