Jordan Boyd-Graber

Nanyang Technological University sweeps the EMNLP best paper awards. :) Congrats to @nehasrikanth.bsky.social! Read the paper here: www.cs.umd.edu/~jbg//docs/2...

Lab meetings recently.

I'm moving to Nanyang Technological University in Singapore to start a new lab! We'll still be dedicated to adversarial QA, human-computer collaboration, probabilistic modeling, and the other fun hijinx my students and I have been up to, but now (hopefully) bigger and better.

I've been connected to the University of Maryland in one way or another since 2009, and that's not going to change with this move. I still have students I remain committed to graduating, and I hope to remain involved with my long-time collaborators.

I'm moving to Nanyang Technological University in Singapore to start a new lab! We'll still be dedicated to adversarial QA, human-computer collaboration, probabilistic modeling, and the other fun hijinx my students and I have been up to, but now (hopefully) bigger and better.

Anyone at ICML (or in Seoul) want to play against an AI in visual quiz bowl at our workshop on the 10th, lunchtime? We have AI opponents and teammates. Reply here or send me an e-mail (jbg@umiacs.umd.edu), subject "EMMQA Expo". Leads appreciated! youtu.be/VrsEn_69Nb8

Anyone at ICML (or in Seoul) want to play against an AI in visual quiz bowl at our workshop on the 10th, lunchtime? We have AI opponents and teammates. Reply here or send me an e-mail (jbg@umiacs.umd.edu), subject "EMMQA Expo". Leads appreciated! youtu.be/VrsEn_69Nb8

The first deadline for submitting a paper to our workshop is today, but there are lots of opportunities to participate: submit a trivia playing robot, play yourself, or write (multimodal) questions. Please share the word! (More details/links in the first comment.)

Can you spot when AI bluffs? Can you outguess AI or work with one to dominate trivia? Can you make an AI that can figure out tricky visual questions?

Sign up to play here: qanta-org.github.io/competition/... Submit systems here: qanta-org.github.io/competition/... Submit adversarial questions here: qanta-org.github.io/competition/... Take part in our ICML 2026 workshop: qanta-org.github.io/competition/...

Can you spot when AI bluffs? Can you outguess AI or work with one to dominate trivia? Can you make an AI that can figure out tricky visual questions?

My students and I are presenting three papers on Monday at #ACL2025 and this thread will recap them (including their videos).

Finally, this evening I'll be standing in for @wwongkamjan.bsky.social at the Findings poster (18:00, Hall X4/X5): Should I Trust You? Detecting Deception in Negotiations using Counterfactual RL x.com/joywwong/sta...

My students and I are presenting three papers on Monday at #ACL2025 and this thread will recap them (including their videos).

In the second oral paper (14:22 PM, Room 1.62), @yysung.bsky.social is presenting: GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration x.com/YooYeonSung1... (Short version: quiz bowl, a dumb trivia game, shows humans' calibration > LLMs'.)

My students and I are presenting three papers on Monday at #ACL2025 and this thread will recap them (including their videos).

In the first poster session (11AM Monday, Hall X4/X5), @nbalepur.bsky.social is presenting: Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas x.com/NishantBalep...

We had our first human–computer cooperative AI tournament at the UMD. Key takeaways: 1) computers are getting better at trivia 2) they still suck at calibration 3) our teaming mechanic kept the games competitive and mostly fun (at least that’s what the players said).

If this sounds like fun, we have more information on the setup here: sites.google.com/view/qanta/2...

We had our first human–computer cooperative AI tournament at the UMD. Key takeaways: 1) computers are getting better at trivia 2) they still suck at calibration 3) our teaming mechanic kept the games competitive and mostly fun (at least that’s what the players said).

Sara’s Crias went 4-2 to win the tournament (and $150 dollars). Noah Sheidlower’s music packet was the most difficult for computers, and Jame Carlson’s Spatial Reasoning was the fan favorite. We’ll announce writer and computer prizes after our online mirror. (And also post the packets.)

Today is the deadline to sign up for our Human-Computer trivia competition held on June 14, 2024 in College Park, MD. $150 prize for the team who can answer the most questions with the help of an AI.

Sign up to play here: docs.google.com/forms/d/e/1F...

Do you like trivia? Can you spot when AI is feeding you BS? Or can you make AIs turn themselves inside out? Then on June 14 at College Park (or June 21 online), we have a competition for you.

The questions will be specially designed to sound (mostly) normal to humans but often stump computers (“adversarial”). If you think you can write questions like that, you can submit your questions to the tournament too (but not if you’re playing).

Do you like trivia? Can you spot when AI is feeding you BS? Or can you make AIs turn themselves inside out? Then on June 14 at College Park (or June 21 online), we have a competition for you.