Post

Anthropic hired the former head of Google Books to oversee its secret "Project Panama," new court docs show — quietly buying millions of used books in bulk, breaking their spines and scanning them to feed into its Claude chatbot. wapo.st/4rjXAMQ

58 reposts132 likes

I mean the point isn't *the physical media,* unless you're talking about a rare book. If there are many copies, each one doesn't matter. This sounds like fetishism, like you care about "books" because they are paper, but not about the information they convey

that's not true though? archive.org will very often destructively scan things, especially when they are building the OCR friendly edition for screen readers and they absolutely need the higher quality scans. they stream it, it's fun background noise

Would love your source on this. I’ve been to the IA and seen the tools they use. Their core device is the Scribe Workstation, a cradle with suspended cameras that shoot each page (digitization.archive.org/digitization/). It may be slower than other methods but it is indeed the method they use.

digitization.archive.orgDigitization » Internet Archive Digitization ServicesLearn how Internet Archive digitizes collections with non-destructive scanning, metadata integration, and global access through Archive.org's open platform.

It's possible, but slower, less accurate, more expensive, and only really useful for rare books where the physical item should be preserved. It's not necessary for every mass market paperback copy languishing in warehouses for years on end.

This a much more measured and accurate post than your previous one. Digitization is many things, and IA has shown how to do it at scale without distraction. In fact, Better World Books, who supplied many of the books to the Panama Project is supplied by books scanned at IA.

Anthropic's project to "destructively scan all the books in the world" was actually viewed as the *more* ethical and legally sound approach to training its AI. Previously the industry standard had been simply to pirate vast "shadow libraries" of digitized books for free online. wapo.st/4rjXAMQ

Yep. The world just has more books than it can use. Once I learned that libraries regularly burned books just for inventory reasons, I stopped caring about anyone else burning them for non-ideological reasons.

yeah, it's so funny that 'breaking spines' is specifically intended as some sort of visceral reaction or something it's a book? it's a bunch of paper bound together with glue? they are inherently mass-produced objects? these aren't some rare one-of-a-kind first editions or something, it's fine

No actually I get it every time someone creases the spine on a book I feel an overwhelming desire to hit them over the head with it because it's NOT EVEN HARD TO NOT DO THAT *UGH.*