Anne Scheel

Anne Scheel

@annemscheel.bsky.social

Assistant prof at Utrecht University, trying to make science as reproducible as non-scientists think it is. Blogs at @the100ci.

3.4K followers791 following435 posts

Pinned

Anne Scheel
@annemscheel.bsky.social

New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr

tinyurl.comCareer incentives make Registered Reports unattractive under realistic academic conditionsRegistered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...

Anne Scheel reposted

Vilgot Huhn
@vilgothuhn.bsky.social

Replying to @dingdingpeng.the100.ci

i dont get it either but my take away is that for association you need basically any data, for causation you need a good RCT, and for mediation you need time-travel and for God to be on your side

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci

Still upset about that highly cited paper in Psych Science you consider deeply flawed? Now is your time to shine ✨

simine vazire@simine.com

Another special issue at Psych Science! We invite “submissions that advance the field through critical appraisal of articles previously published by Psychological Science” Please share! www.psychologicalscience.org/publications...

psychologicalscience.orgSpecial Issue Call for Submissions: “Appraising the Foundations of Psychological Science”Editors: Tom Beckers and Heather UrryOne way a journal can earn its reputation for quality is to take active steps to vet the articles that appear within its pages after publication. To that end, Psyc...

Anne Scheel reposted

Magnus Johansson
@pgmj.bsky.social

Our commentary "A Revolution in Search of an Estimand: On the Idionomic Proposal of Hayes et al. (2026)" is now available as a preprint: osf.io/preprints/ps... With @rpsychologist.com, @matti.vuorre.com, and Nils Hentati Isacsson.

osf.ioOSF
Magnus Johansson@pgmj.bsky.social

Interesting timing. I just noticed this paper: Hayes, S. C., Ciarrochi, J., Sahdra, B. K., Hofmann, S. G., Ong, C. W., & Hernández, C. (2026). One size fits none: A call for an idionomic revolution. Clinical Psychology Review, 129, 102800. doi.org/10.1016/j.cp...

doi.orgRedirecting

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci
Per Engzell@pengzell.bsky.social

Boy is this something I should have done years ago... but finally revamping my first-year undergrad methods to start from - @nickchk.com's theeffectbook.net - @dingdingpeng.the100.ci's 2018 AMPPS piece journals.sagepub.com/doi/10.1177/... Let's go

Anne Scheel reposted

Beth Clarke
@bethclarke.bsky.social

Come work on a PhD in Metascience with me! There’s just a little over one week left to apply!

Beth Clarke@bethclarke.bsky.social

I’m hiring a PhD student to work with me on metascience in psychology at @zpid.bsky.social! The position is very open - could cover a wide range of topics/themes 🤸🏻‍♀️✨ If you have questions, please reach out! Applications are open until October 1st. leibniz-psychology.onlyfy.jobs/en/job/fyjwt...

leibniz-psychology.onlyfy.jobsPhD in Psychological Meta-Science (m/f/d)Become part of the open science movement The Leibniz Institute for Psychology Information (ZPID) in Trier (Germany) is an internationally recognized research-based psychology service center located in...

Anne Scheel reposted

Malte Elson
@malte.the100.ci

No ground truth, no witnesses. Uh. Yeah. [Verse] Roll up on the dataset, don't standardize a thing, Raw units, mixed scales, let the big variable be king. Pick my k in advance 'cause I already know the story, Three clusters in the grant, so it's three, that's the glory. - Clusta Rhymes

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci

This is an *excellent* post on cluster analysis. If you ever thought about applying cluster, latent class or latent profile analysis to psychological scales, you absolutely should read this!>

Jan Vanhove@janhove.bsky.social

New blog post: "Cluster analysis: A skeptic’s guide". In which I ask a few questions that social scientists wishing to identify hidden classes in their data ought to address. janhove.github.io/posts/2026-0...

Anne Scheel reposted

Ruben C. Arslan
@ruben.the100.ci

Replying to @ruben.the100.ci

To be clear, I'm not against it. It's a bit annoying to have to read so many verbose AI reports, but I still think this is preferable to the regime of before, where most scientific work was never rechecked and many errors languish in code, polluting the record.

Anne Scheel reposted

Ruben C. Arslan
@ruben.the100.ci

An interesting thing is happening to me at the moment. I have a standing bug bounty policy for my first authored scientific work. That means, I've committed to pay people who report bugs in my code, up to 750€ for severe errors. Since GPT-6 Astra came out, I'm now getting several bug reports daily.

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci

Very few people know that this is how it all began @celestialsem.bsky.social

Emily Riederer@emilyriederer.bsky.social

For no real reason, I was looking up something about the ancestry of causal DAGs in path diagrams and came across this picture. I got to see it so you do to. HT to Sewall Wright who both set the course for a very useful analytical tool but also took the time to include cute drawings of guinea pigs

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci

I am once again begging everyone who supervises student theses to stop making students conduct mediation analyses because “a regression isn’t complicated enough for a thesis” 😭

Anne Scheel reposted

Saloni
@scientificdiscovery.dev

There are entire articles written around the problem of why the prevalence of type 1 diabetes has risen - nutrition? toxins? - that don't even consider whether it might be because fewer patients are dying young & continue to be in the numerator. This should be step 1

Anne Scheel reposted

Lukas Röseler
@aufdroeseler.bsky.social

I meant to post that #FLoRA now has over 2,500 replications and reproductions - but we are already at >2,600! This is only possible due to our team of >200 researchers submitting + validating entries, approving them, and maintaining the search pipeline and validation app. forrt.org/flora-explor...

Anne Scheel reposted

Daniel Lakens
@lakens.bsky.social

New Blog post: Which Data Repository Should you Use? In light of OSF closing down, I compare Zenodo, Dataverse, ResearchBox, PsychArchive, and local repositories on six important dimensions. If you want to know which to pick: It depends! daniellakens.blogspot.com/2026/08/whic...

daniellakens.blogspot.comWhich Data Repository Should You Use?The Center for Open Science has announced that from November 16, 2026, no new projects can be created on the Open Science Framework. After F...

Anne Scheel reposted

Daniel Lakens
@lakens.bsky.social

The Metacheck team is busy building an improved version of the osf_download function (www.scienceverse.org/metacheck_bo... ). You will soon be able to use metacheck to download all files, wikis, and meta-data. You will also be able to upload everything to Zenodo.

scienceverse.org36  Checking Local Files with repo_check and code_check – The Metacheck ManualA guide to Metacheck, an R package providing a module based tool for checking scientific manuscripts and data repositories for best practices using text search, R code, and optional LLM queries.

Anne Scheel reposted

Saloni
@scientificdiscovery.dev

Something I learnt recently: Amazon stores all the highlights you make in Kindle here read.amazon.com/notebook which you can copy into an LLM to turn into structured notes. That way I can spend more time doing something I like (reading) and less time on something I don’t (making notes)

Anne Scheel reposted

Julia M. Rohrer
@dingdingpeng.the100.ci

New blog post! Odds ratios are...a bit weird. Here I explain two problems (interpretation, non-collapsibility) and provide some simple recommendations for improved reporting. www.the100.ci/2026/07/30/r...

the100.ciReviewer notes: Odds ratios are really oddWhen psychological researchers investigate binary outcomes, they routinely report odds ratios to quantify the strength of an effect or an association. This is quite understandable given that psycholog...
Anne Scheel
@annemscheel.bsky.social

This paper has been a long time in the making, but it’s been a super fun and interesting journey. Special thanks to Leo Tiokhin, who convinced me that models from biology can be very fruitful for meta-science and taught me a ton in this process! 17/17

Anne Scheel
@annemscheel.bsky.social

Of course there are important limitations of our findings. This is a very simple model that ignores many important factors influencing authors’ choices IRL, like working in teams or the time it takes to publish a paper. It’s also based on a very simplistic idea of publication bias. 14/

Anne Scheel
@annemscheel.bsky.social

Our goal was to isolate and study the effects of the difference in payoff variance in RRs and standard reports, and those alone produce patterns that are quite different from the ‘RRs are low-risk and therefore attractive to researchers’ story (which I used to believe myself!). 15/

Anne Scheel
@annemscheel.bsky.social

Our results generally suggest that in many realistic scenarios, RRs may actually be quite unattractive for researchers who need to further their careers in a culture that values long and high-impact publication records. This could mean that further uptake of RRs isn’t just a matter of time! 12/

Anne Scheel
@annemscheel.bsky.social

2) Being able to run many studies before being evaluated (e.g., applying for a job) cancels out most other effects. Researchers with 'slow pace', e.g. in fields with slow or costly data collection, are most affected by increasing/decreasing career returns, publication targets, and competition. 10/

Anne Scheel
@annemscheel.bsky.social

3) Hard publication targets make RRs unpopular if the target can’t be met with RRs alone. If it can, it makes RRs more attractive than at baseline. 4) Competition is the biggest RR-killer in our model. Intense competition makes them widely unpopular & completely unviable in fields with low pace. 11/

Anne Scheel
@annemscheel.bsky.social

We varied four career-relevant factors: * how much each additional publication increases career success (increasing/decreasing returns) * how many studies researchers can run before being evaluated * hard publication targets (e.g., in tenure agreements) * competition (e.g., for jobs or grants). 8/

Anne Scheel
@annemscheel.bsky.social

Key findings: 1) RRs are more popular when career returns for publications are decreasing, e.g. in advanced career stages. This contradicts data showing that RRs are more often used by ECRs. Our model may miss other important factors (quite possible!), or ECRs don't use optimal strategies yet. 9/

Anne Scheel
@annemscheel.bsky.social

Our paper examines what this may mean for the popularity of RRs. We borrowed risk-sensitivity theory from behavioural ecology (which was developed for animals facing a choice between foraging in patches with high vs low food variance) to build an evolutionary agent-based model. 6/

Anne Scheel
@annemscheel.bsky.social

In our model, 500 simulated researchers choose between RRs and standard reports using an innate publication strategy. They accumulate payoffs for each publication and then pass their strategies on to the next generation. Strategies evolve based on which choices lead to more 'career fitness'. 7/

Anne Scheel
@annemscheel.bsky.social

Conversely, when taking the standard publication route, authors run the risk of getting no publication at all, but they also retain a (tiny, but non-zero) chance of getting into a blockbuster journal if their study comes up with ground-breaking results. 4/

Anne Scheel
@annemscheel.bsky.social

In terms of career incentives, RRs have lower payoff *variance* than standard reports. They’re the safe choice but will ~never get you to the absolute top. By contrast, standard reports are a gamble. RRs should thus be attractive to *risk-averse* researchers, but that’s not necessarily everybody! 5/

Anne Scheel
@annemscheel.bsky.social

New preprint w/ Leo Tiokhin & @lakens.bsky.social! Registered Reports (RRs) are great for science b/c publication is guaranteed before results are known, reducing publication bias & QRPs. This feature supposedly also makes them great for *scientists*. But is that really true? 1/ tinyurl.com/4sy993rr

tinyurl.comCareer incentives make Registered Reports unattractive under realistic academic conditionsRegistered Reports are a publication format designed to reduce publication bias by guaranteeing publication before results are known. This guarantee is considered attractive in the prevailing ‘publish...
Anne Scheel
@annemscheel.bsky.social

How often do you come across a Registered Report? Although they’ve been adopted by lots of journals and numbers of published RRs have risen steeply, they’re still extremely rare compared to e.g. preregistered papers. If they’re so beneficial for authors, then why aren’t they more popular? 2/

Anne Scheel
@annemscheel.bsky.social

RRs reduce the risk that a study can't be published at all (no payoff) — good. But authors don't just want publications, they ideally want high-impact publications. RRs lock authors into a specific, usually not high-IF, journal before results are known, which reduces maximum payoff — less good. 3/

Anne Scheel reposted

Saloni
@scientificdiscovery.dev

Strep A kills hundreds of thousands of people per year, but there's no vaccine for it – yet. Some of my wonderful colleagues at Coefficient Giving and lots of great scientists are trying to change that. Please share this with researchers who might be interested in working on it!

Katharine Collins@kat-a-collins.bsky.social

📣Exciting announcement 📣 The First Global Strep A Vaccine Conference Call for abstracts will open soon! 🌏Venue update: Kuala Lumpur, Malaysia, first week of February 2027 📝Abstract submissions open 30 July 2026. #GSAVConference2027 Read the full announcement here ⬇️ lnkd.in/eiu95fXm