xavier roberts-gaal

xavier roberts-gaal

@xrg.bsky.social

three language models in a trench coat harvard psych, oai safety fellow (xavierrg.com)

159 followers187 following31 posts

Pinned

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

xavier roberts-gaal reposted

I have a new paper. We look at ~all stats articles in political science post-2010 & show that 94% have abstracts that claim to reject a null. Only 2% present only null results. This is hard to explain unless the research process has a filter that only lets rejections through.

xavier roberts-gaal reposted

🚨New Preprint: We develop a novel task that probes counterfactual thinking without using counterfactual language, and that teases apart genuine counterfactual thinking from related forms of thinking. Using this task, we find that the ability for counterfactual thinking emerges around 5 years of age.

xavier roberts-gaal reposted

🚨 New preprint 🚨 Across 3 experiments (n = 3,285), we found that interacting with sycophantic (or overly agreeable) AI chatbots entrenched attitudes and led to inflated self-perceptions. Yet, people preferred sycophantic chatbots and viewed them as unbiased! osf.io/preprints/ps... Thread 🧵

love this really elegant paper spearheaded by Linas! one of the clearest instances of resource-rational social cognition i've seen worth a read!

Linas Nasvytis@linasnasvytis.bsky.social

🚨New paper out w/ @gershbrain.bsky.social & @fierycushman.bsky.social from my time @Harvard! Humans are capable of sophisticated theory of mind, but when do we use it? We formalize & document a new cognitive shortcut: belief neglect — inferring others' preferences, as if their beliefs are correct🧵

xavier roberts-gaal reposted

💙New paper!💙 How is knowledge transmitted across generations in a foraging society? With @danielredhead.bsky.social we found: In BaYaka foragers, long-term skills pass in smaller, sparser networks, while short-term food info circulates broadly & reciprocally academic.oup.com/pnasnexus/ar...

academic.oup.comTransmission networks of long-term and short-term knowledge in a foraging societyAbstract. Cultural transmission across generations is key to cumulative cultural evolution. While several mechanisms—such as vertical, horizontal, and obli

xavier roberts-gaal reposted

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

View full thread

In short: do you need to worry about experimenter demand ruining *your* online study? Based on our evidence, probably not. That's good news for the field! As we argue, demand effects appear, at least in their simplest form, to be more phantom than menace (7/8)

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

View full thread

To answer this, we used obvious ("We hypothesize...") and subtle demand manipulations ("These images are designed to make you feel more warmth toward the average [conservative/liberal]") In each case we verified participants correctly understood study hypotheses. (5/8)

Then we measured participants' dictator game behavior, moral vignette judgments, and change in ingroup attitudes after an intervention (we used an inert subliminal priming intervention for measurement purposes). Control and demand conditions were statistically indistinguishable! (6/8)

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

View full thread

...and demand effects are most often observed with small student samples or very heavy-handed cues ("You will help us if you...") But modern psychology experiments use experienced online samples and standardized paradigms. Is demand a realistic concern in this setting? (4/8)

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

In three preregistered studies (N=2,254), we revealed the study’s hypothesis. Participants’ beliefs changed but their behavior didn’t. In other words, in a dictator game, a moral vignette, and an attitudes intervention, we created experimenter demand but it had no effect! (2/8)

xavier roberts-gaal reposted

🔥Exciting news in experimental philosophy🔥 Very happy to announce that there will be soon a new journal named “Experimental Philosophy”. It will be open access, free of charge for authors and follow all Open Science principles. Editors and Editorial Board below. More information coming soon...

View full thread
View full thread

people say how money should be split between two parties who differ only in what they can earn on their own when the parties are negotiating, people think it's most fair for the party with a better outside option to take a larger share as a function of their bargaining power

by contrast, in a donation context where bargaining does not apply, moral intuitions completely reverse! people instead think it's most fair to redistribute money to the party who can earn less on their own -- or to split the money equally

should we treat people equally? give more to the needy? sometimes, people think it's fair for those who start out already advantaged to get more -- think bonuses, salary negotiations, and so on in two experiments, we show how the logic of bargaining can govern these moral intuitions!

xavier roberts-gaal reposted

CALL FOR PAPERS: SPP 2024 The Society for Philosophy and Psychology (SPP) invites submissions of papers to be presented at its 50th Annual Meeting to be held June 19-June 22, 2024 at Purdue University (local organizer: Corey Maley).

xavier roberts-gaal reposted

Delighted to share this new preprint lead by Arthur Le Pargneux. When somebody needs to "take one for the team" (pull a late night, walk an extra mile, trudge through mud), do people think that moral responsibility falls upon whoever has the weakest bargaining position? osf.io/preprints/ps... 1/2

xavier roberts-gaal reposted

If you know any undergrads who would like to do something very adventurous next summer (experiments on learning in single cell organisms), have them get in touch with me.

xavier roberts-gaal reposted

Our new R package makes it easy to report the percentage of effect sizes that a given effect is larger than for a given research field. So instead of reporting a 'medium' effect, you can say something like, "we found an effect that was larger than 42% of effect sizes reported in the field"

PsyArXivBot@psyarxivbot.bsky.social

A tutorial for calculating field-specific effect size distributions: http://osf.io/h368x/