Post

Had a small part of this that I am pretty proud of: Full push-button reproducible manuscripts from data to manuscript. Nearly every stat, figure, number, table, etc is pulled directly from analysis code and data and "knit" with manuscript text written in Google Docs. Blog post coming soon ...

Today, the SCORE program releases its primary results! 865 researchers examined research credibility across the social and behavioral sciences, publishing three papers in Nature + five preprints. 📑 Explore the papers: www.nature.com/colle... ℹ️ Read more about SCORE: www.cos.io/score

Reproducible manuscripts are useful for a few reasons: One of the best reasons is just practicality. The thing most of us do where we have to manually update every stat/figure etc in a manuscript every time something changes in the code or data is super error-prone and time consuming.

0 reposts3 likes

Then there is rigor and accountability. Anyone can trace every stat and figure to *exactly* how it was estimated. If there's an error or a way you think things should have been done instead, it's super findable. As a bonus, that incentivizes code readability, since people might use it.

Reproducible manuscripts have been around since code existed, but they are still pretty rare and mostly written in scripting langauges (text and everything) like RMarkdown. For SCORE, the text is written collaboratively via Google Docs, enabling modern collaborative writing with a large team.

I hope y'all tear into it and find any lurking issues, questions, ideas for your own work, etc. Gotta say it's a bit terrifying to have the entire pipeline so fully exposed and accessible, particularly one as complicated and high profile as SCORE. But more importanty, I hope it's useful.