Dirk Wulff

Dirk Wulff

@dirkwulff.bsky.social

Cognitive and decision science at MPI for Human Development & Uni Basel | Data science at therbootcamp.github.io | R, language models, and sustainability (text2sdg.io).

715 followers375 following91 posts

πŸ“£ Delighted to share that I have joined WU (Vienna University of Economics and Business) as Professor of Artificial Intelligence and Behavioral Science. Announcements for at least one postdoc-level position will follow soon. Please reach out if you are interested.

🚨 Now out in PNAS In decision research, "talk is cheap." We show it isn't. Using LLMs to analyze participants' free-text explanations of their choices, we find verbal reports are a rich, scalable window into how people actually decide. πŸ”— www.pnas.org/doi/10.1073/... Led by Kamil Fulawka

View full thread

Finally, we show that all of this means that the psychological profile of LLM responses can be steered through the design of the measurement instruments, with profiles of very capable models varying dramatically as a function of whether forward or reversed instruments were used.

These results reflect poorly on the value of human instruments for LLM profiling. However, they are not driven by standard post-training biases and do not rule out the existence of stable dispositions in LLM. We call for the design of dedicated instruments. Preprint: arxiv.org/abs/2606.20205

arxiv.orgApparent Psychological Profiles of Large Language Models are Largely a Measurement ArtifactPsychological instruments designed for humans are increasingly used to assign large language models (LLMs) stable psychological profiles that affect their usability, safety assessment, and use as prox...
View full thread

We show that response bias in LLMs is partially but not fully reduced for larger and proprietary versus open models, with all models exceeding the level of response bias in humans.

Across 29 self-report and task instruments measuring personality and risk-taking, we show that reliability (internal consistency) is driven by response bias and therefore is fully dependent on the instruments' levels of response orthogonality.

We base our analysis on a formal psychometric framework that unifies the idea of reverse-keying across self-report and task instruments under the notion of response orthogonality.

For a big five inventory, we show that our sample of LLM models (N = 56) scatters along an axis indicative of response biases-driven responding, opposite to the pattern found in humans.

🚨 Last chance to register - please share 🚨 πŸ“£ Behavioral Clones Workshop - Join us online! One-day workshop on behavioral clones β€” πŸ€– AI systems that model human behavior β€” following the Machine+Behavior conference. πŸ“… May 20, 9 am - 6:15 pm (CET) πŸ”— Register: www.eventbrite.ch/e/behavioral...

eventbrite.chBehavioral Clones online participationA one-day workshop on behavioral clones β€” AI systems that model human decision-making and social behavior.

🚨 Additional tickets 🚨 πŸ“£ Behavioral Clones Workshop - Join us online! One-day workshop on behavioral clones β€” πŸ€– AI systems that model human behavior β€” following the Machine+Behavior conference. πŸ“… May 20, 9 am - 6:15 pm (CET) πŸ”— Register: www.eventbrite.ch/e/behavioral...

πŸ“£ Postdoc position Build πŸ€– LLM-based behavioral clones for economic games together with PΔ±nar Uğurlar and me. The position (up to 3 years) is based in PΔ±nar's lab at Γ–zyeğin in Istanbul, with regular visits to my lab. Please share / reach out if interested. πŸ”— drive.google.com/file/d/1ftqi...

πŸ“£ PsychLing-101 β€” Deadline May 1 Join us in building a large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation. So far: 36 submissions and 40M+ observations All contributors become coauthors 🀝 πŸ”— Visit github.com/Data-X01/Psy...

github.comGitHub - Data-X01/PsychLing-101: Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community.Large-scale, trial-level psycholinguistic database for cumulative science and LLM evaluation, driven by the community. - Data-X01/PsychLing-101

Dirk Wulff reposted

πŸš€Introducing π†π”πˆπƒπ„-π‹π‹πŒ: A reporting checklist for using LLMs in behavioral & social science βœ…GUIDE-LLM is a reporting checklist designed by 80+ experts to improve transparency, reproducibility & ethical accountability of LLM-based research πŸ“„ llm-checklist.com

llm-checklist.comGUIDE-LLMReporting Checklist for Studies with Large Language Models in the Behavioral and Social Sciences

🚨 Deadline extension 🚨 BEHAVIORAL CLONES WORKSHOP Imitating humans is a powerful route to machine behavior and an emerging lens on human cognition and social simulation. πŸ—“ Fri, 20 May 2026 πŸ“ Following Machine+Behavior @ Max Planck Berlin πŸ—£οΈ Invited talks: Danica Dillion, Raja Marjieh, Marcel Binz

The workshop focuses on machines trained to replicate human behavior, as scientific models of human cognition and action, as tools for large-scale behavioral simulation, and as objects of study in their own right. We invite talks, lightning talks, and posters.

🚨 7 days left to submit your work!

Dirk Wulff@dirkwulff.bsky.social

WORKSHOP ON BEHAVIORAL CLONES Imitating humans is a powerful route to machine behavior and an emerging lens on human cognition and social simulation. πŸ—“ Fri, 20 May 2026 Following Machine+Behavior @ Max Planck Berlin Invited talks: Danica Dillon, @marcelbinz.bsky.social

We show that accessibility cascades from lexical to semantic information similarly across all transformer language models, but is still realized differently in encoder and decoder models.

We further demonstrate an important moderating role of embedding extraction method and confirm results suggesting that final-layer embeddings underrepresent psycholinguistic information.

The workshop focuses on machines trained to replicate human behavior, as scientific models of human cognition and action, as tools for large-scale behavioral simulation, and as objects of study in their own right. We invite submissions for talks, lightning talks, and posters.

Dirk Wulff reposted

I am hiring a postdoc for a DFF-funded project on social influence, and the decision processes that fuel rich-get-richer dynamics in the online/offline world. The position is for up to a year, competitive Danish salary, remote work possible. Interested or know somebody? DM me or share!

Dirk Wulff reposted

🚨 New preprint - Advancing Cognitive Science with LLMs Excited to share this new preprint together with Rui Mata. We review how πŸ€– LLMs can help address long-standing problems in cognitive science, highlighting opportunities and pitfalls. πŸ”— Preprint: arxiv.org/abs/2511.00206

🚨 New preprint - Advancing Cognitive Science with LLMs Excited to share this new preprint together with Rui Mata. We review how πŸ€– LLMs can help address long-standing problems in cognitive science, highlighting opportunities and pitfalls. πŸ”— Preprint: arxiv.org/abs/2511.00206