Post

layers.pub now has an official data PDS at repo.layers.pub as well as a python client and CLI that you can read about at layers.pub/lairs/!

The layers repo currently contains all license-compatible UniMorph lexicons (unimorph.github.io), Universal Dependencies treebanks (universaldependencies.org), and PropBank annotations (propbank.github.io) pointing into those treebanks, alongside additional lexical resources.

Additionally, repo.megaattitude.io and repo.decomp.io host the MegaAttitude and Universal Decompositional Semantics datasets, the latter of which has pointers into the UD treebanks living on repo.layers.pub.

The lairs client is set up to make it easy for you to post your own data to your PDS and to access and work with others' data.

On the writing side: you can author records as typed models and lairs applies them to your PDS as a minimal diff. It also has codecs for converting between Layers and formats like CoNLL-U and brat, and exporters to HuggingFace datasets, PyTorch, and WebDataset.

lairs is built on didactic (panproto.dev/didactic/), which provides pydantic-like typed models for the pub.layers.* lexicons.

didactic is itself built on panproto.dev, which handles migration within and between formats (e.g. between layers data model versions or from CoNLL-U to layers).