Post
a.i. in fact makes developers less efficient (while perceiving themselves as more efficient)
arxiv.orgMeasuring the Impact of Early-2025 AI on Experienced Open-Source Developer ProductivityDespite widespread adoption, the impact of AI tools on software development in the wild remains understudied. We conduct a randomized controlled trial (RCT) to understand how AI tools at the February-...
Have you ever run against a study that changed a belief that you held deeply? Or do you dismiss anything you dislike without looking into it? Because while 18 minutes is enough time to read a paper, you seem to disagree with it while stating that if it were true that it wouldn't matter. Why is that?
I read and wrote about that paper at length when it came out simonwillison.net/2025/Jul/12/...
simonwillison.netMeasuring the Impact of Early-2025 AI on Experienced Open-Source Developer ProductivityMETR - for Model Evaluation & Threat Research - are a non-profit research institute founded by Beth Barnes, a former alignment researcher at OpenAI (see Wikipedia). They've previously contributed ...