William J. Brady

William J. Brady

@williambrady.bsky.social

Associate prof @ Kellogg School of Management, Northwestern University. Studying emotion, morality, social networks, psych of tech. #firstgen college graduate

5.9K followers370 following170 posts

Pinned

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

Glad to see a revised version of this out now at Current Opinion in Psychology! www.sciencedirect.com/science/arti...

sciencedirect.comsciencedirect.com
William J. Brady@williambrady.bsky.social

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

View full thread

📣 Students & postdocs: submit your research! We're selecting 2–3 data blitz talks per keynote theme, + posters. 🏆 New this year: committee will pick one data blitz speaker for the inaugural Computational Psychology Early Career Research Award, judged on rigor + novelty.

Excited to work on this with a great team ✨ Stay tuned for some hiring announcements if you're interested in these topics!

Joshua Conrad Jackson@joshcjackson.bsky.social

I’m excited to announce that our proposal (with @williambrady.bsky.social and @douglasguilbeault.bsky.social ) “Fostering Innovation Through Humility in the Online Marketplace of Ideas” was funded by the John Templeton Foundation We'll be hiring for this grant soon. Details about the project below!

William J. Brady reposted

New paper out today in Social and Personality Psychology Compass! What happens when our moral values come into conflict? Our new paper explores "metamorality": the second-order principles we use to navigate conflicting moral choices. W/ Jesse Graham

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

View full thread

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

View full thread

Generative AI distorts differently. Predicting the most probable next token and tuned toward annotator-preferred text, LLMs converge hard on the modal answer — in some forced-choice tests placing 99%+ probability on a single response to questions people are split on. Both routes corrupt learning.

The result: pluralistic ignorance and false consensus. The upside: if the problem is upstream, the fixes can be too. As engagement algorithms keep their dominance and generative AI proliferates, we discuss two solutions worth taking seriously.

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

View full thread

The key point: those biases are "smart shortcuts" — but only when the visible sample is representative. If what looks common really is common, conforming is rational. If who looks respected really is competent, deferring is rational. Both engagement algorithms and generative AI break that "if."

They corrupt the upstream sample, so downstream biases act on bad input ("upstream selection problem"). Engagement algorithms optimize for attention, which is drawn to emotional, moral, conflict-heavy content from a small hostile minority. Feeds overrepresent extremes, bury the moderate majority.

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

View full thread

How does social learning work? We see 2 stages: upstream selection (what becomes visible to us) and downstream selection (what we copy from that visible sample). Downstream is shaped by well-studied biases: conformity (copy what looks common) and prestige (copy whoever looks respected/competent).

In 2023 we showed how engagement-based algorithms exploit human social learning biases, distorting how we learn what's normal, common, or credible from each other ("Algorithm-mediated social learning," Trends in Cognitive Sciences). The obvious follow-up: where does generative AI fit in?

In our new paper we ask: when probing LLMs for opinions, ideas, or a read on what a group thinks, does that fix the skew engagement algorithms introduced? We argue and review evidence that the answer is "no".

William J. Brady reposted

New: Researchers have quantified how easy AI search is to manipulate. Just 13 words buried in a random Reddit comment can poison AI search results. They suggest this is not easy to stop: "The way you can attack these systems is so much dumber than you think it is" www.404media.co/it-is-trivia...

404media.coIt Is Trivially Easy to Use Reddit to Manipulate AI Search, Research Suggests"We show that a tiny snippet—just 13 words—of retrieved text on a UGC website like Reddit, Wikipedia, Quora, or Facebook can change AI agents to output spam / scam content pretty consistently."

William J. Brady reposted

Researchers looked at people’s positions on specific issues, rather than just whether they identified as conservative or liberal. They found 43% of self-identified conservatives supported mostly left-leaning policies on topics like spending, climate action, immigration, and vaccine mandates.

academic.oup.comThinking Ideologically: The Limited Role of Left and Right Labels as Policy ShortcutsAbstract. How do voters use left-right ideological labels as shortcuts for policy positions in evaluating electoral candidates? We offer a distinction betw

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

As I mentioned in the below thread, this project involved many feats of engineering, led by the fantastic @markptorres.bsky.social. If you're a CS or CSS person interested in the gory details, see his blog post: markptorres.com/research/202...

markptorres.comHow we built the infrastructure for a large-scale social media field experiment during the 2024 US electionWhat we built
William J. Brady@williambrady.bsky.social

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

There are TONS of other interesting results, positive findings and nulls, that are in the paper. There are also 240(!) pages of SI material. If you have a question or analysis idea, we probably thought of it 😎

Many limitations, including the fact that Bluesky population changed dramatically(!) in the middle of our study. Our participants were earlier users, but users who joined later express more outrage! (see SI). How does this generalize to other platforms, etc? See discussion

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

Result 3: Null finding: We found no evidence that algorithms changed people's own engagement behavior with IME/toxic content. Engagement was extremely rare & concentrated (top 5% of users = 75% of all toxic engagement). Exposure shifted; behavior, at least over 2 months, didn't.

Result 4: it's often assumed that dialing down divisive content hurts user experience. Our data suggest that tradeoff may be overstated—the diversified extremity feed reduced toxic/IME content while maintaining overall login freq and (even improving) overall platform enjoyment (see discussion)

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

Result 2: Engagement-based feeds raised perceived partisan animosity (esp. after the election) AND reduced norm perception accuracy. Unexpected: for norm-perception people underestimated how acceptable others found toxic political content.

Our best explanation: amplified toxic posts often came wrapped in visible condemnation (critical replies, quote posts). Seeing others push back may have signaled that toxic posting was less acceptable—even as the overall vibe felt more hostile.

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

One cool thing about our study is we estimated true base rate of content in English-speaking content across WHOLE study period. Thus, we can show that this amplification of IME content is an *overrepresentation* = misrepresents true base rate on platform (see methods)

Another interesting tidbit: because we designed our own engagement algo, we could see separate influence of personalized vs community engagement signals. Turns out community signals are much more responsible for IME amplification (see SI)!

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

View full thread

Another goal we had: show one way to do an algo RCT independent of industry. We engineered our own ranking algorithms on @bsky.app, giving us full control & transparency over how they worked—less black box, no conflicts of interest, no concerns of changes during study. Ok, now results:

Result 1: engagement-based feeds amplified IME & toxic content vs. a chronological feed. The biggest jumps were in moral outrage (up to +79%) and political content (up to +57%) after the election. Our diversified extremity algorithm reduced this exposure (by aiming to reduce extreme users)

✨New paper out @nature.com ✨ For 8 weeks around the 2024 US election, we randomly assigned 2,000 people to use social media algos we built ourselves. Do engagement-based algorithms amplify intergroup, moral & emotional (IME) content—and does that distort how we see political norms? 🧵🔗 👇

We also built & tested an intervention: a "diversified extremity" algorithm. Instead of amplifying outgroup posts (which can backfire), it reduces the outsized influence of extreme users—who post most of the toxic political content—to make feeds more socially representative.

William J. Brady reposted

This paper benefitted enormously from the very involved and insightful editorial team @nature.com, led by @meharpist.bsky.social.

Mary Elizabeth Sutherland@meharpist.bsky.social

Millions of people(including me) turn to LLMs for information and advice. But who shapes their output? A @nature.com paper shows the influence of state controlled media on LLM output. Read all the details in the article here: www.nature.com/articles/s41...

William J. Brady reposted

William J. Brady reposted

📣 The difference between replicable and not replicable is not itself scientifically replicable. 📣 New work with Erkan Buzbas, showing that verdicts such as "X% of results replicated" are based on an inferential machinery that doesn't work. arxiv.org/abs/2604.26268

William J. Brady reposted

Climate change impacts are here, but public support for action remains polarized. Which climate messages move people? In a ~13,500-person megastudy, we tested 10 of the most-cited messages. Six increased pro-environmental attitudes in the U.S.—but only by 1–4 percentage points. 🧵

William J. Brady reposted

Is social media dying? How much did Twitter change as it became X? Which party now dominates the conversation? Using nationally representative ANES data from 2020 & 2024, I map how the U.S. social media landscape has changed Here are the key take-aways 🧵 Full paper out now in in JQD:DM!

journalqd.org Shifts in U.S. Social Media Use, 2020–2024: Decline, Fragmentation, and Enduring Polarization | Journal of Quantitative Description: Digital Media

William J. Brady reposted

New preprint! ✨ Do you and your partner have made-up words ("eggy" to mean awkward)? Do you and your bestie have an anecdote you love to tell together (that time one of you tripped over an acorn)? Do you and your closest colleague have a cherished ritual (weekly lunch at "the usual spot")? 🧵