Post

Institutional Books is expanding. The Institutional Data Initiative @institutional.org at @harvardlawadmin.bsky.social Library has added paragraph-level text analysis and 22M extracted images to our work on ∼1M books, opening new possibilities for research, experimentation, and discovery. 🧵

IDI

@institutional.org

Enriched Text contains 217B tokens from 983K @harvardlibrary.bsky.social volumes, organized into 1.39B annotated paragraphs across 250 languages. Researchers can use the dataset to analyze language, repeated passages, line breaks, and paragraph predictability.

8/9/26, 2:06 pm0 reposts4 likes

IDI

@institutional.org

8 Sept

Visual Elements extends the dataset to images embedded in scanned pages, producing 22.6M visual elements – including illustrations, photographs, charts, musical notation, and decorative materials – linked to their source volumes and pages.

IDI

@institutional.org

8 Sept

Together, these projects establish Institutional Books as an ongoing resource that can grow through continued research and community use. The open-source pipelines can be adapted to new collections, models, languages, and questions: institutional.org/posts/extend...

institutional.orgExtending Institutional Books with enriched text and 22M extracted images | IDIThe Institutional Data Initiative at the Harvard Law School Library expands the ~1M-book Institutional Books dataset with paragraph-level text analysis and 22M extracted images, enabling new forms of ...

IDI

@institutional.org

8 Sept

The Institutional Data Initiative at Harvard @institutional.org works with knowledge institutions to increase the availability, diversity, and responsible use of training data for AI. Reach out and join us.