Post

I’ve long used FiveThirtyEight’s interactive “Hack Your Way To Scientific Glory” to illustrate the idea of p-hacking when I teach statistics. But ABC/Disney killed the site earlier this month :( So I made my own with #rstats and Observable and #QuartoPub ! stats.andrewheiss.com/hack-your-way/

434 reposts1.4K likes

I was just going to test my in-class activity for tomorrow and found that this was gone! Glad I looked at Bluesky (read: procrastinated) rather than prepping a new activity. Thanks so much for saving this resource!

I don't get it, why would this be evidence of misconduct? One doesn't publish a non-significant finding unless it happens by chance in a list of comparisons. Even in PLoS ONE people don't bother to write up the non significant directions.

And if a scientist were to track every single z-score/p-value they ever generate, it still shouldn't be a null distribution because then they are *definitely* not enriching over the null distribution in their investigations.

Because they do not publish a non significant finding. Why ? Or, maybe some of this non significant finding are reworked (Data can be filtered, truncated or reshaped, like in the example above) in order to reach the threshold.

I am very interested in the implementation here, because the page is pretty fast (by comparison to Shiny pages, which in my opinion are nearly always ridiculously slow, and the ways to not make them slow that people suggest are always huge kluges that seem totally unnecessary).