Alex Coppock

Alex Coppock

@aecoppock.bsky.social

Associate Professor of Political Science at Northwestern University alexandercoppock.com Persuasion in Parallel: https://alexandercoppock.com/coppock_2022.html Research Design: Declaration, Diagnosis, and Redesign: book.declaredesign.org

6.7K followers1.5K following644 posts

Alex Coppock reposted

Social desirability bias is smaller than most people assume. In Blair, Coppock and Moor's (2020) metanalysis found clear effects only for (1) Support for auth regimes (in autocracies) and (2) vote buying. www.cambridge.org/core/journal...

Matt Grossmann@mattgrossmann.bsky.social

Lot of fear of people lying to polls. We don't have much evidence for it & don't need it to explain error. People uncomfortable sharing their choice are more likely to be in the now ~98% of people who don't respond than to take ~20 min survey to lie. Non-response much bigger deal

It's really true! Y_post - Y_pre ~ Z almost ALWAYS has worse precision than Y_post ~ Z + pre (compare teal "difference-in-difference" to gold "ols" in plot below)

Brendan Nyhan@brendannyhan.bsky.social

Friends: We have to stop running experiments where the outcome is a difference score. It is strictly worse in terms of statistical power. declaredesign.org/blog/posts/u... Control for the pre-treatment outcome instead! (example)

Alex Coppock reposted

Our large-scale study of phone bans just came out in Science. We randomized phone-free classrooms for 16,000+ students across 10 institutions in Odisha, India. Students deposited phones in a box at the start of each class, for a full semester.

New from Hainmueller and Laitin on the causal effects of becoming a citizen on wages. Short story: the observational ests overstate the premium relative to the experimental ests. Authors conclude "observational averages should not be used as causal forecasts for policy" doi.org/10.1073/pnas...

When oh when will polling outfits stop asking "more/less likely" questions? No way does this promise make 27% of the country *much less likely* to vote R, No way does this promise make a different 11% of the country *much more likely* to vote R!

JLRay@jlray.bsky.social

The latest from YouGov: Does Trump's $5,000 promise make you more/less likely to vote R: Less +11 Would Trump keep this promise: Pro/definitely not +44 Would you be better off if Dems/Reps won in November: Dems +8 Everyone knows Trump is a liar. yougov.com/en-us/daily-...

Alex Coppock reposted

Applications are open for EuroWEPS Berlin.👇There is also some change in the EuroWEPS organising committee. @pavisuri.bsky.social is taking a step back, while @aalrababah.bsky.social & @ewirsching.bsky.social are joining starting with this edition. A big thank you to Pavi & welcome to Ala and Elisa!

Anselm Hager@anselmhager.bsky.social

EuroWEPS 14 is here! We'll meet in Berlin @wzb.bsky.social and discuss designs/papers focusing on causal inference. No presentations, just constructive discussions. Early career scholars especially welcome to apply! Deadline is Sept 11.

Alex Coppock reposted

Not on the committee but happy to chat!

Alex Coppock@aecoppock.bsky.social

Northwestern is hiring in quant methods (assistant level, tenure track) Please repost and share with those you think would be good candidates, thank you! polisci.northwestern.edu/about/facult... #psjobs #psjminfo #poliscijobs

Alex Coppock reposted

Northwestern poli sci is hiring in quant methods! I'm not on the committee, but I AM excited to welcome new junior colleagues. We're also hiring in IR -- separate search, same amazing department (and university!)

Alex Coppock@aecoppock.bsky.social

Northwestern is hiring in quant methods (assistant level, tenure track) Please repost and share with those you think would be good candidates, thank you! polisci.northwestern.edu/about/facult... #psjobs #psjminfo #poliscijobs

Just an enormous difference in Russian support for the war when comparing direct question estimates with experiments from list experiments. Also, peep those CIs! sensitivity bias has to be HUGE (which it apparently is in this case) to be detected with Direct - List

Georgy Tarasenko@tarasenkogeorgy.bsky.social

Every wave after that splits. Direct support holds at ~75%. Indirect support drops to 44–58%. The gap runs from 16 to 30 percentage points.

View full thread

A favorite part was the "estimand census", in which we enumerated all of the estimands estimated in the published papers, but also all the the estimands that *could have been* estimated given the design. We (a) add many new published quantities and (b) show how little overlap there is for most qs

We are so grateful to the many authors who conducted these experiments and posted their data (or shared when we asked) -- synthesis like this obviously depends on the efforts of others. If you've read this far thank you! If you're so moved, please share the top post, quoted below:

Alex Coppock@aecoppock.bsky.social

Our (with Radha Sarkar) meta-reanalysis of the experimental religion and politics literature is now out at @apsrjournal.bsky.social Open-access link: doi.org/10.1017/S000... Brief thread

The headline finding is that the effects of religious messages average about a percentage point. The effects vary widely, from precisely estimated 0-point effects to precisely estimated 10-point effects! We do not understand why, though we try to sort through some possibilities.

Alex Coppock reposted

I'm thrilled to share that my dissertation has been selected as the co-winner of the Best Dissertation Award from the APSA Women, Gender, and Politics Section. Many thanks to the award committee, and to mentors and colleagues who offered support along the way!

I really hope that Sociology reforms. My main work is reanalyzing other scholars' experiments in service of meta-analysis. It's only possible because transparency is embraced so thoroughly by our political science community. Most exps are posted; i'm getting ~80% when I email for the rest.

John Holbein@johnholbein1.bsky.social

Only 9.9% of top Sociology articles from 2019-2024 provided replication packages. And ≈ half of those with replication packages could not be verified due to missing or incomplete materials. www.econstor.eu/bitstream/10...

Alex Coppock reposted

We have a new paper out on what the large conjoint literature tells us about public opinion on immigrant characteristics:

Marcel Roman@mfroman.bsky.social

🚨NEW PUBLICATION🚨 in Science Advances. We meta-reanalyze 100 conjoint experiments to assess which immigrants citizens prefer around the world. Our evidence reinforces existing findings, identifies novel insights, and provides a basis for future research 1/n www.science.org/doi/10.1126/...

Alex Coppock reposted

🚨NEW PUBLICATION🚨 in Science Advances. We meta-reanalyze 100 conjoint experiments to assess which immigrants citizens prefer around the world. Our evidence reinforces existing findings, identifies novel insights, and provides a basis for future research 1/n www.science.org/doi/10.1126/...

science.orgWhich immigrants do citizens prefer? A meta-reanalysis of 100 conjoint experimentsMeta-reanalysis of 100 conjoint experiments reveals patterns of similarity and variation in public immigration preferences worldwide.

Alex Coppock reposted

Thrilled this is finally out in its JOP-formatted version! Hope it's useful to anyone working on LGBT politics, (electoral) discrimination, status differentials within & across identity categories, and non-textual experiments. Main findings in quoted thread. www.journals.uchicago.edu/doi/epdf/10....

Martin Naunov@naunovmartin.bsky.social

1/ Much has been said about 🇺🇸 becoming more accepting of gay candidates—especially since Pete Buttigieg’s presidential run. But I ask: What kind of gay candidates no longer face discrimination? And, specifically, how does gender presentation affect electoral viability?

Alex Coppock reposted

Replying to @ajordannafa.com

He talked about description as well, including the specific recommendation to avoid associational language, simply because it has become so ambiguous (so not "is SES associated with Y" but rather: do people of different SES differ on average in Y).>

Alex Coppock reposted

Alex Coppock reposted

this is so interesting, i think this is basically a kind of ecological study

Alex Coppock reposted

Climate change impacts are here, but public support for action remains polarized. Which climate messages move people? In a ~13,500-person megastudy, we tested 10 of the most-cited messages. Six increased pro-environmental attitudes in the U.S.—but only by 1–4 percentage points. 🧵

Alex Coppock reposted

Once again asking people not to post about poll results without links to the surveys, and not to repost anything that cites poll results without links to the surveys. This is not (primarily) about credit, it's a data credibility check.

Friends, you've been submitting great proposals for this project and we're now coming up to capacity. We're closing proposals on April 15th; please send yours in!

Alex Coppock@aecoppock.bsky.social

🎺 Call for proposals 🎺 1️⃣ replicate an existing experiment 2️⃣ run a novel experiment on repdata.com 3️⃣ coauthor with Mary McGrath and me to meta-analyze the replications and existing studies 4️⃣ publish your study details: alexandercoppock.com/replication_... applications open Feb 1 please repost!

Nice new entry in the persistence literature

📰 Do the effects of partisan media fade quickly or accumulate over time? ➡️ Using multiwave experiments, M Baum et al. show a single exposure can have effects lasting up to a week, while cumulative effects are hard to detect www.cambridge.org/core/journal... #FirstView

Alex Coppock reposted

🧵1/ Our first meta-science paper (with 350+ coauthors) is published today in Nature. It presents one of the largest-ever reproducibility projects in economics & political science. Here’s what we found 👇

Alex Coppock reposted

Alex Coppock reposted

Psychology has a whole cottage industry in which people come up with some construct that is essentially "attitudes/beliefs/expectations/feelings about X", and then the central claim is that this construct is a super important determinant of future X outcomes.>

Alex Coppock reposted

I'm hiring a postdoc! @goetheuni.bsky.social Focus: CSS, political behavior, political communication & transforming information environments. 📍 Frankfurt | ⏳ 3 years | 📅 Deadline: 14 April 2026 Full job ad here: www.uni-frankfurt.de/48794987/Zen... (search for “political behavior” to find it)

uni-frankfurt.de Goethe-Universität — Zentrale Einrichtungen Die Goethe-Universität ist eine forschungsstarke Hochschule in der europäischen Finanzmetropole Frankfurt. Lebendig, urban und weltoffen besitzt sie als Stiftungsuniversität ein einzigartiges Maß an E...
View full thread

This scatterplot shows the correlation of pre-treatment party with hypothetical party ID; off diagonals show imagined "party switching". Not *zero* in the SQ condition, but substantially larger in the partisan hypothetical conditions.

This project grew out of repeated failure to move party ID experimentally with "light" treatments (nulls that we document in this paper). We learn from the hypotheticals project that HUGE treatments might change things (to the tune of about 5\% of partisans switching)

Congratulations to @yamilrvelez.bsky.social, @patrickpliu.bsky.social, and @scottclifford.bsky.social ! we think attitudes are some function of beliefs; our exps routinely move beliefs but not (even correlated) attitudes. This team found a way to guess which beliefs matter more (and they do!)

Yamil Ricardo Velez@yamilrvelez.bsky.social

Conditionally accepted at the APSR (w/ @scottclifford.bsky.social & @patrickpliu.bsky.social): Why does political information so often change beliefs but NOT attitudes? We highlight the role of belief relevance, or the extent to which beliefs bear on attitudes.

also of interest @patrickpliu.bsky.social's thread on the working paper

Patrick Liu@patrickpliu.bsky.social

🧵 Why do facts often change beliefs but not attitudes? In a new WP with @yamilrvelez.bsky.social and @scottclifford.bsky.social, we caution against interpreting this as rigidity or motivated reasoning. Often, the beliefs *relevant* to people’s attitudes are not what researchers expect.

Alex Coppock reposted

Alex Coppock reposted

Reminder to register (no fee) for the Rebecca Morton experiments conference at NYU taking place next week. Join us: nyu.qualtrics.com/jfe/form/SV_...

nyu.qualtrics.comSurvey | Qualtrics Survey SoftwareSurvey Software, Enterprise Survey software for enterprise feedback management and CRM solutions. Enables high-quality data collection, panel management and results analysis. Perfect for market resear...
Gwyneth McClendon@gmcclendon.bsky.social

JOIN us for this year’s Rebecca Morton conference on experimental political science at NYU! March 6-7. We have a great line up of papers and posters! Program (scroll down) here: wp.nyu.edu/cesspolitica... Register (no fee) here: nyu.qualtrics.com/jfe/form/SV_...

Alex Coppock reposted

Per protocol analysis strikes again! Folks, if you randomize but then don‘t analyze some of the people who got randomized (maybe because they didn’t adhere to instructions, maybe because they dropped out), randomization will no longer do all the heavy causal inference lifting.

Peter Tennant@pwgtennant.bsky.social

This recent RCT of an "AI stethoscope" claims the technology "shows promise" for diagnosing cardiovascular conditions. It does not. It is a textbook example of the risks of conducting unprincipled 'per protocol analyses'. Once again, peer review at a major medical journal has failed. 🧵 1/

*maybe* this journal mistakenly thought the author submitted a registered report (or similar). But if the position is "papers must not be pre-registered" I'd love to hear the justification.

Jan R. Boehnke@jrboehnke.bsky.social

Interesting start to the week: Paper rejected with the justification that the journal does not accept pre-registrations or manuscripts that are based on pre-registrations 🤔🤪 #Registration #PreRegistration #RegisteredReport

Thank you for all the support and reposts! We've gotten a steady stream of inquiries and submissions for this competition, but also some ANXIETY that the window will close before people have a chance to submit. We're nowhere near that! We'll update on here when we've allocated 50% of the capacity.

Alex Coppock@aecoppock.bsky.social

🎺 Call for proposals 🎺 1️⃣ replicate an existing experiment 2️⃣ run a novel experiment on repdata.com 3️⃣ coauthor with Mary McGrath and me to meta-analyze the replications and existing studies 4️⃣ publish your study details: alexandercoppock.com/replication_... applications open Feb 1 please repost!

Alex Coppock reposted

Very excited to see this out at @bjpols.bsky.social! In this article, I show that contemporary political news coverage makes it challenging for readers to learn information that is helpful for democratic accountability, even for very politically engaged audiences. A brief summary:

NEW - The Unequal Challenge of Learning from Under-Informative News - https://cup.org/461vHAT - @atrexler.com #OpenAccess