Marek Vranka reposted
Understanding Maximum Likelihood Estimation, now in 3D!: rpsychologist.com/likelihood #dataviz #stats #rstats
Marek Vranka
@mvranka.bsky.social
psychologist & researcher, interested in soc and moral psy, statistics & critical thinking
310 followers188 following385 posts
Marek Vranka reposted
Understanding Maximum Likelihood Estimation, now in 3D!: rpsychologist.com/likelihood #dataviz #stats #rstats
Marek Vranka reposted
CrossRef, a major gateway from journal articles to scholarly database, implemented CRediT back in July, but what we hadn't noticed was that the blogpost that introduces it mentions that CRediT has been "made available in multiple languages", which I'm pretty sure is a reference to our work!
Marek Vranka reposted
Glad to see our article in latest @ejisbisa.bsky.social issue. @smetanamichal.bsky.social, @laurensukin.bsky.social, @mvranka.bsky.social & I use survey experiments to show how public opinion can sometimes influence US & UK elite views on nuclear weapon use. #OpenAccess: doi.org/10.1017/eis....
Marek Vranka reposted
Why is Psych Science doing a bunch of special issues? We want to get more submissions on these topics! Authors may not submit papers on these topics because they don’t see many examples in our journal. Hopefully special issues can help! www.psychologicalscience.org/publications...
Marek Vranka reposted
so, I've always suspected my wife has a lot of tabs open and was actually a bit disappointed that when I installed an extension that counts them on her firefox, it said she >only< had like 393... turns out, the counter was not able to display more than three digits and she actually has 3930+🥲
I didn't think I'd watch someone with 30 tabs open in the same window trying to look for a tab, failing to find it, and then opening the same page in a new tab, but I did and it was very uncomfortable to watch.
Marek Vranka reposted
This document is going to be an assigned reading in college classes that cover this moment in time, there's a lot happening in a few paragraphs... www.ahmath.org/statements
as one of those interested but unable to join, I am very excited (and happy!) about this announcement! (so much I am even willing to undertake the traumatizing experience of opening ms teams)
We are excited to announce that we are going to broadcast the second day of Meta-Research Symposium 2026 (this Friday on October 9th) for those who were interested but unable to join in person. JOIN: teams.microsoft.com/l/meetup-joi... PROGRAM: docs.google.com/document/u/0...
Marek Vranka reposted
Replying to @syeducation.bsky.social
I would still prefer OSF or a relevant clinical trial registry for study registration. Study plans or protocols shared in other repositories are nice, but they are not "study registrations." Registrations need to be in a formal registry, following Box 2 here: osf.io/preprints/me...
no need for AI to be better at peer review than humans, it could complement human reviewers especially in parts humans suck at / are too lazy to do thouroughly - like checking reporting, stats, preregistration deviations etc. let's leave the "not original enough" judgment for human Rev 2...
Weekend reads: ‘The Weimar of knowledge’; ‘Could AI Be Better at Peer Review Than Humans?’; guidelines in South Korea ban hidden prompts, restrict AI use
Marek Vranka reposted
New post and game by me! Some people claim that AI will cure all diseases in 10 years. Others are more skeptical, arguing that experimentation and clinical trials are the bottleneck. Who's right? I designed a game to find out.
Marek Vranka reposted
With the recent mainstreaming of AI concerns, I'm very disappointed that we haven't heard more about supporting proof of personhood tools and techniques, which some have worked on for more than a decade. news.mit.edu/2024/3-quest...
Marek Vranka reposted
I usually don't love the central role Harvard has to play in all our higher ed convos, but I think Anastasia Berg is right to point out that this is a grotesque abdication of the responsibility they so proudly accept as a representative of the liberal arts. www.chronicle.com/article/harv...
Marek Vranka reposted
Marek Vranka reposted
Machine learning and generative LLMs are subject to many of the same drawbacks and issues as general empirical research in the typical publishing system. In this piece now published at NHB we argue that, like for empirical research, ML and LLMs can benefit from the use of Registered Reports.
How Registered Reports can improve trust in machine learning research
Marek Vranka reposted
Marek Vranka reposted
Trump’s Golden Dome scam is all gold and no dome. The program gave contractors $3.2 billion to develop space interceptors that we already know can’t possibly work. There are several excellent studies out there showing why. Here’s a new one I strongly recommend. thebulletin.org/2026/09/defe...
this amazing #metasci event (again!) somehow flew under my radar - paulmeehlschool.github.io/workshops/sy... - although submissions are closed, registration is still open, so check it out! (I will squeez my very limited budget and try joining as well!) @youngmetascience.bsky.social
Marek Vranka reposted
Modern academic structures are constraining scientific creativity A new paper says research is structured around short funding cycles, productivity-based evaluation criteria, and risk-averse frameworks that favor predictable and non-transformative research outputs. www.nature.com/articles/s41...
this is really cool replication idea!
3/ They screened all 73 papers in top econ journals (2015–Aug 2025) using Google Trends, kept 24 with rep packages + sufficient data documentation, re-downloaded every query on 40 separate days, and re-ran the original code 40 times. 3,640 estimates. Research design held fixed.
Marek Vranka reposted
Great news! Some of us have been waiting a long time for major funders to not just shovel $ into the maws of the big publishers, and instead support the long tail of scholar-controlled journals that are run on a shoestring
We're delighted to share news in the attached press release that the Open Journals Collective has received a major award of $711,900 from the Gates Foundation to grow support infrastructure for community-governed journals! Want to know more about OJC? Visit www.openjournalscollective.org
Marek Vranka reposted
I am afraid this is the reason why fraud is actually much more widespread - lots of cheats simply fly under the radar, avoiding scrutiny completely...
The reason we think it’s due to TED talks/books/etc is because thise folks get huge scrutiny once their papers blow up and lots of press when we find fraud. I know of 4 grad students who committed fraud and I can’t even remember their names. Their papers were retracted and there was no press.
Marek Vranka reposted
The number of people doing science opportunistically is great. In 2010, these people p-hacked. In 2026, they do crap preregistrations. Just like we figured out ways to prevent p-hacking, we are finding ways to prevent opportunistic preregistration. The solution is always the same: transparancy.
Are preregs just a way for people to virtual signal now? Comparing pregregs to published papers is very sobering. Also shout out to @debruine.bsky.social and @lakens.bsky.social for metacheck and regcheck @ianhussey.mmmdata.io for making this easy!
Marek Vranka reposted
Slightly-updated verson of tenzing.club now deployed, let us know of any issues. Thanks to floze-the-genius for chipping in and adding the enhancement! github.com/marton-balaz...
I got my hands on a new #socPsy textbook by Hayes & Bradshaw, and of course first thing I checked was how they handle QRPs and replication crisis. and boy, was I disappointed - lots of hand-waiving, downplaying and even a completely made-up term "PHarking" (likely a mash-up of p-hacking and HARKing)
two years ago, Ariely was invited to an event in Czech Republic where he promoted his new book about misinformation, lies, and trust in science... absolutely unbelievable!
I was asked to speak at a conference a couple of years ago. When I found out Ariely was also speaking I told the organizing I was pulling out. I can't understand how Duke University wants to continue to be associated with this. Thanks to Data Colada for this extremely hard detective work.
apropo, has anyone checked data for Ariely's masturbation paper or that one with large stakes in India? there is no way in hell those are not made up as well... maybe @steamtraen.eu knows?
An influential paper by Ariely & Wertenbroch (2002) reported two studies with tampered data. Post 1 of 2. datacolada.org/138
Marek Vranka reposted
An influential paper by Ariely & Wertenbroch (2002) reported two studies with tampered data. Post 1 of 2. datacolada.org/138
Marek Vranka reposted
this is an important clarification for everyone who was worried about how changes at OSF would affect uploading files during preregistration:
File uploads as part of the registrations process will still be available. If you want to have your code as a standalone, citable object then you would need to upload that elsewhere. OSF will be fully supporting preregistration workflows going forward.
Marek Vranka reposted
The Center for Open Science recently announced its decision to phase out OSF Projects. We want to share how those changes will affect PsyArXiv, a psychology preprint server run and maintained by SIPS volunteers but hosted on the OSF platform. improvingpsych.org/2026/08/11/w...
this is Arina Bones levels of prescience! maybe we all really knew the future all along!? ... but kudos for clearly stating the limitations - it seems that predicting actual behavior in the field is much more tricky!
An important limitation: LLM predictions were about 2x too large, on avg. Accuracy also was lower for small effects, treatments on stable attitudes, field outcomes, and non-text treatments. LLM predictions can help inform research but should not replace human evidence.
we started to work on this eons ago (like 2023?) and a lots happened in the meantime, but I believe the main principles we identified are still relevant even today...
Congratulations to the project “Core principles of responsible generative AI usage in research,” which received🏆2026 SIPS commendation! This is an expert-consensus framework that helps assess, document, and report whether the use of GenAI aligns with enduring principles of responsible GenAI use.
Marek Vranka reposted
🔔🔔 Russian polls have shown ~75% support for the war in Ukraine since February 2022, essentially flat. New working paper with Kirill Chmel and @nikitasavin.bsky.social shows that number is stable partly because it stopped measuring what people actually think. 🧵 ssrn.com/abstract=711...
Marek Vranka reposted
The need for this also a major finding of our qualitative work on reproducibility journals.plos.org/plosone/arti...
The @ukrepro.bsky.social STAR report calls for open research approaches that recognise disciplinary diversity. This aligns strongly with work at Leeds, where we've developed 10 methodology-specific Open Research Checklists. We hope to share them soon! www.ukrn.org/2026/07/01/u...
sounds like a dream job!
We are hiring an assistant professor in Metascience! Join our lovely department of Human-Technology Interaction, with a very active Metascience group, at Eindhoven University of Technology. Apply here before August 14, or share the vacancy in your network! www.tue.nl/en/working-a...
Marek Vranka reposted
Nice replication with Norwegian twin data of @pamherd.bsky.social et al.'s polygenic-score-based result that heritability of education increased for women over time with increasing gender equality. www.nature.com/articles/s41... by @olerogeberg.bsky.social @kph3k.bsky.social @torkildl.bsky.social
Marek Vranka reposted
WE ARE HIRING! Come work with us (me + @malte.the100.ci) on developing and validating RegCheck. PhD or postdoc applications welcome. Folk with backgrounds in meta-science, psychology, (pre)clinical trials, and/or economics are especially invited to apply. jobs.unibe.ch/job-vacancie...
Marek Vranka reposted
almost silly how after all those years of talking about DPTs, we only now finally test for mechanisms of how S2 actually spots & corrects errors of S1... before that, it was simply:
In a new paper out in @cognitionjournal.bsky.social, @gordpennycook.bsky.social and I argue the classic view that System 2 spontaneously corrects System 1 is flawed. We provide evidence that S2 is instead triggered by conflict between competing S1 intuitions www.sciencedirect.com/science/arti...
Marek Vranka reposted
📢NEW RESOURCE: A new web resource and accompanying report to explore the vulnerabilities to political interference of 33 key UK scientific public bodies & 11 scientific advisory committees! unchecked.uk/public_body_... 1/7
Marek Vranka reposted
⚡ Metaventory: building better science ⚡ Had many discussions about the need for mapping out all that's meta-science: people, tools, events, jobs, simulations, etc. in one place. Metaventory aims to help connect those interested in meta-science & improving science. metaventory.vercel.app
Marek Vranka reposted
Replying to @lakens.bsky.social
Integrative experiments - where effects are tested across auxiliary assumptions - are a more useful tool than multiverse analysis and many analyst studies. If you like to ponder the philosophical basis of statistical procedures, you might enjoy this paper! osf.io/preprints/ps...