Post

wow I look forward to seeing this post about the behind the scenes

Trackdown package?

Trackdown is great and a VERY similar idea, but has the big limitation that you cannot simultaneously work on analysis code/data/etc and the manuscript narrative text. Editing has to be iterative one after the other, which was impractical for us. So we rolled a (slightly hacky) homebrew solution.

Code and data (both for the analyses and for the knit itself) are of course available and linked in the papers. For the paper on reproducibility, see here osf.io/ed8pj/overview For the paper on replicability, see here osf.io/g5sny/overview Code/data are CC0 1.0 Universal, enjoy!

Reproducible manuscripts are useful for a few reasons: One of the best reasons is just practicality. The thing most of us do where we have to manually update every stat/figure etc in a manuscript every time something changes in the code or data is super error-prone and time consuming.

Then there is rigor and accountability. Anyone can trace every stat and figure to *exactly* how it was estimated. If there's an error or a way you think things should have been done instead, it's super findable. As a bonus, that incentivizes code readability, since people might use it.