David Smith

David Smith

@dasmiq.bsky.social

Associate professor of computer science at Northeastern University. Natural language processing, digital humanities, OCR, computational bibliography, and computational social sciences. Artificial intelligence is an archival science.

5.5K followers305 following421 posts

David Smith reposted

Replying to @si-wu.bsky.social

While in Paris, I’m giving a talk at Inria on Nov 6 (also on Zoom!) about my PhD work on how humans and machines understand concepts, from mental imagery in text to how "equivalent" words differ in meaning across languages and cultures. Abstract & details in the image 👇

David Smith reposted

I’m at #EMNLP2026 until Oct 30, then in Paris until Nov 8! Old friends and new: if you’re in either city, happy to chat about research or just grab coffee/food/drinks/dessert! I’m also on the lookout for postdoc and industry positions, so feel free to reach out about that too!

David Smith reposted

JOB(S): My dept has an open rank open specialties (w/in Information Science / Library & Archival Science & closely related) search out of which we hope to make multiple hires! Im not on the committee but can say we'll have new teaching needs in social impacts of information technology & also ethics!

jobs.wisc.eduAssistant / Associate / Full Professor  - Madison, Wisconsin, United StatesCurrent Employees: If you are currently employed at any of the Universities of Wisconsin, log in to Workday to apply through the internal application process.Job Category:FacultyEmployment Type:Regula...

David Smith reposted

David Smith reposted

Find us at #EMNLP2026 to learn about narrative qualities of pretraining data! 🌟 📊 Via our Explorer tool, you can interact with 13M pretraining passages and 11 narrative dimensions, plus upload your own data for analysis: cls-lab.colorado.edu/tejo9855/dol... We'd love to see what you discover! 👀

Teagan Johnson@teagrjohnson.bsky.social

I'll be presenting our work on characterizing the narrative content of web-scale data at #EMNLP2026! @andrewpiper.bsky.social @elliottash.bsky.social ash.bsky.social @mariaa.bsky.social @emnlpmeeting.bsky.social Would love to see you there! 📍 Hall H, Poster Session F 🕘 Tue Oct 27, 9:00-10:30

Really nice analysis by @wouterhaverals.bsky.social et al. of a “schoolbook canon” of prosody using text reuse and our passim tools!

Wouter Haverals@wouterhaverals.bsky.social

Grouped by literary period, we also see bigger shifts: the classical translations that organized 18thC verse teaching gave way to a Romantic, lyric repertoire whose lines could travel without much context. Poems became important because their lines could be copied, taught, remembered and reused.

Oulipan deformance avant la lettre

Wouter Haverals@wouterhaverals.bsky.social

Thomas Gray's Elegy shows what some of these books did to a poem: its lines were recited, set to music, accused of plagiarism, misquoted, and chopped into specimens of meter. A 1906 grammar book even treated the poem as a scrapyard of adjectives! ✂️

I’m really happy to see @si-wu.bsky.social ‘s paper out now. Taking advantage of literary works, where we often have multiple very different translations, for both training and evaluation, is very exciting!

Si Wu @ EMNLP@si-wu.bsky.social

Literary works are often translated into the same language multiple times, and each translation interprets the original in its own way. How can we use these different translations to train better literary MT systems? Can synthetic references be as good as human ones?

David Smith reposted

Literary works are often translated into the same language multiple times, and each translation interprets the original in its own way. How can we use these different translations to train better literary MT systems? Can synthetic references be as good as human ones?

David Smith reposted

Replying to @asheeshks.org

There is a very powerful narrative in the history of the humanities about the alleged centrality of bildung rather than research that only works if you ignore, as that narrative does, the profound imbrication of the practices of reading and writing that came to be 'humanistic' in government.

David Smith reposted

Replying to @asheeshks.org

I wrote a whole book about this! Research is and has always been central to the humanities! It's not a late breaking addition that emerged in response to the research culture of the natural sciences. yalebooks.yale.edu/book/9780300...

yalebooks.yale.eduThe Archive of EmpireHow modern data-driven government originated in the creation and use of administrative archives in the British Empire   Over the span of two hundred years, ...

David Smith reposted

Too many people are calling on the community to "change how we value papers". Not enough people are posting "this is what we look for in our next hiring round".

David Smith reposted

“AnaChartiste”— to appreciate this, you need to know that the trained archivists who graduate from the École des Chartes have a reputation for being rigid, rule following etc. So that they* have been angered to anarchism… is something

Pierre Col@pierrecol.bsky.social

Les pancartes des élèves archivistes qui bloquent pour la première fois l'École Nationale des Chartes sont top !

David Smith reposted

This talk by @himself.bsky.social was wonderful. Models mechanize, map, + remix the "house of intellect", connecting together previously disconnected hallways of knowledge. LLMs are not stochastic parrots but mechanical bards. Cites: Jacques Barzun, Albert B. Lord, Nestor Guillen, Herbert Simon

Maria Antoniak@mariaa.bsky.social

Henry Farrell is giving a talk on culture and AI now at #COLM2026 and it's off to a blazing start. Join in the ballroom!

David Smith reposted

This is a good question, given how language models are usually explained as giving the most likely completion/correction of a text. How would they ever decide to emend a text to be more unusual?

Joel@sentantiq.bsky.social

the fundamental question I have had for these applications is how can LLM or statistical based methods support the "lectio difficilior?

View full thread

Popping back up to the original question, my own professional deformation makes me think that individual text restorations are just one output of a fuller model of collation, including the tricker cases of documentary texts drawn from a (usually unknown) archival context. Fun work to do, though!

This is a good question, given how language models are usually explained as giving the most likely completion/correction of a text. How would they ever decide to emend a text to be more unusual?

Joel@sentantiq.bsky.social

the fundamental question I have had for these applications is how can LLM or statistical based methods support the "lectio difficilior?

View full thread

Things are a little more complicated nowadays since it's convenient for many reasons to train LLMs are single models instead of breaking them up into language and channel models. But the key is to provide enough context to make the lectio difficilior easier to predict.

This is a good question, given how language models are usually explained as giving the most likely completion/correction of a text. How would they ever decide to emend a text to be more unusual?

Joel@sentantiq.bsky.social

the fundamental question I have had for these applications is how can LLM or statistical based methods support the "lectio difficilior?

You can't just pick the most likely string of English, e.g., "the". You also have to model how likely it is that one text could have been corrupted into another.

David Smith reposted

Postdoc (18 months) at Inria Paris! Let's go back together to the manuscripts behind Dees' Atlas of Old French, with CATMuS & CoMMA, and measure how editors shaped our dialect maps. Skills: Old French, palaeography, TEI. Latin a +. Deadline 30/11 recrutement.inria.fr/public/class... #digimed #DH

recrutement.inria.frPost-Doctoral Research Visit F/M Postdoctoral Researcher in Medieval French Philology in the ROMAM2 ProjectOffre d'emploi Inria

David Smith reposted

🚨 [Token][ization] Paper Alert 🚨 Tokenization is a wildly understudied area of language modeling despite it having effects across all of NLP. Over the past ~8 months, 32 (!) tokenizer researchers put together the most comprehensive survey of the field. Check it out!

We can put a 10ft human skeleton in the front yard of anyone who wants one. Why don’t we have the supply chain to put a T. rex or triceratops skeleton on every corner?

Nina Beguš@ninabegus.bsky.social

Delivering dinosaurs for exhibit at the Boston Museum of Science. Arthur Pollock, 1984

David Smith reposted

If you're at #COLM2026, come check out our poster for "Spoiler Alert" (arxiv.org/abs/2604.09854). We ask why LLM fiction is so bad at holding narrative tension, and create a metric to measure tension in short stories. What improves LLM fiction on this metric, it turns out, is narrative planning.

David Smith reposted

Cool post-doc opp for recent graduates in computer science & AI from Schmidt Sciences; broad range of AI topics that intersect with comp social sci. & humanities, esp. problems with alignment, interpretability, and knowledge production. Great foundation to work with: jobs.lever.co/schmidt-enti...

jobs.lever.cojobs - Fellow in ResidenceSummary Schmidt Sciences invites recent PhD graduates in AI and computer science to apply for a 12-18 month fellows-in-residence program, with the possibility of extension to 24 months. Fellows would ...

David Smith reposted

I'm recruiting 1-2 PhD students to join our lab in Fall 2027, through either Computer Science or Information Science at the University of Colorado Boulder! Looking for people with interests in NLP plus [healthcare | literary studies | narratives | social media | etc.]. Join us! 🏔️☀️

cls-lab.comCLS Lab — Culture, Language, & Systems | University of Colorado BoulderThe Culture, Language, & Systems Lab at CU Boulder studies the language systems that transmit and shape modern culture, from internet platforms to literary archives to language models.

David Smith reposted

[New preprint] How do images in VLMs align with words? In this work, we found a set of attention heads responsible for OCR. But to our surprise, these heads were actually able to verbalize much more than just text. So, we used them to create a simple logit lens for image tokens!

David Smith reposted

David Smith reposted

David Smith reposted

while we continue to do battle with bot swarms (and hope to agreed on a more advanced strategy with Tufts), this paper appeared. Useful as the Perseus DL can be as a website, our bigger contribution is probably providing data for many other projects. This only begins the story.

David Smith reposted

and here's the link to the NLP class David @dasmiq.bsky.social and I co-taught last fall. hopefully it will be helpful to people as well! siwu.io/nlp-class/

siwu.ioCS 6120 Natural Language Processing
Lucy Li@lucy3.bsky.social

now that a substantial proportion of my time is spent teachng, i am so grateful for people who make their lecture slides public so mine will be public too! lucy3.github.io/cs769-fall26...

David Smith reposted

What does the history of copying machines teach us? That we should leave copying to machines and focus on interpretation, intent, and meaning - our human powers.

Nina Beguš@ninabegus.bsky.social

@kyliu99.bsky.social's thought-provoking piece on copying in humans and machines, The Art of Copying, has been published in @lareviewofbooks.bsky.social. The essay is a part of our volume First Encounters with AI, forthcoming with @uofmpress.bsky.social. lareviewofbooks.org/article/ken-...

David Smith reposted

Replying to @rtommccoy.bsky.social

Paper: arxiv.org/abs/2608.29530 We consider a variety of neural networks that perform seemingly-symbolic tasks, from small-scale models trained on simple list-manipulation tasks to LLMs performing tasks in math, logic, coding, and language. 2/n

arxiv.orgThe Emergent Symbolic Structure of Artificial Neural NetworksModern systems in artificial intelligence (AI) somehow excel in domains for which they seem poorly suited. Intelligence has traditionally been modeled as operating over structured combinations of symb...