Ever used AI to fix tricky race conditions and flaky tests? Not pretty, is it? Check out "Spaghetti Bench 🍝: A SWE-Agent Benchmark for Concurrency Bug Tasks" Turns out it's still a HARD problem, but it can be made tractable with deterministic replay. pastalab.org/spaghetti-be...
Rohan Padhye
Rohan Padhye
@rohan.padhye.org
Computer Science professor at CMU. Doing research on automated software testing and bug finding. https://rohan.padhye.org
530 followers108 following35 posts
My students wrote a blog post explaining the problem with some neat examples. pastalab.org/spaghetti-be...
SPLASH and ISSTA are going to be co-located in 2026 at Oakland, CA! 🥳 If you would like to run a workshop in PL/SE/Testing, submit a proposal by Jan 10th: conf.researchr.org/track/splash... Contact @sholtzen.bsky.social or me for questions.
Rohan Padhye reposted
⏱️ 9 days until submission deadline (Dec 11, 23:59 AoE). Organized by: @yannicnoller.bsky.social, @rohan.padhye.org, @ruijiemeng.bsky.social, and Laszlo (@lszekeres.bsky.social) Szekeres.
#FUZZING'26 CALL FOR PAPERS ────── ✨ After 5 years, we will be again co-located with NDSS! 🔗 fuzzing-workshop.github.io 📅 11. Dec (Submission) //cc @mboehme.bsky.social (MPI-SP), @ruijiemeng.bsky.social (CISPA), @rohan.padhye.org (CMU), László Szekeres (Google)
Rohan Padhye reposted
Replying to @antithesis.com
Youtube: youtu.be/oF7krd0TQks Spotify: open.spotify.com/episode/2PH7... Apple Podcasts: podcasts.apple.com/us/podcast/f...
Check out the latest episode of the #BugBash podcast! I had a great time chatting with David Wynn about automated testing in academia vs industry. Thanks @antithesis.com for having me on!
If a debate breaks out at your dinner table, take a break and listen to @rohan.padhye.org share how two camps that have long misunderstood each other - industry and academia - can learn from each other instead. This latest ep of the #BugBash podcast is live now, whereever you get your podcasts.
Update: Mostly a success. On arrival I was able to read basic signs during my ride from 인천공항 to 서울. Super elegant and easy to learn script! Quite compositional much like Devanagari (Sanskrit/Hindi/Marathi) which I'm already familiar with. - 로힌
Excited to be on my way to ASE in Seoul! Aiming to learn some Hangul on the flight. @aseconf.bsky.social
Excited to be on my way to ASE in Seoul! Aiming to learn some Hangul on the flight. @aseconf.bsky.social
Rohan Padhye reposted
Gaetano's paper on Scaling Security Testing by Adressing the Reachability Gap has been accepted at #ICSE26! 📝 gpsapia.github.io/files/ICSE_2... 🧑💻 github.com/GPSapia/Reac... How to scale automatic security testing to arbitrary systems?
Rohan Padhye reposted
#FUZZING'26 CALL FOR PAPERS ────── ✨ After 5 years, we will be again co-located with NDSS! 🔗 fuzzing-workshop.github.io 📅 11. Dec (Submission) //cc @mboehme.bsky.social (MPI-SP), @ruijiemeng.bsky.social (CISPA), @rohan.padhye.org (CMU), László Szekeres (Google)
Podcast! Had a fun conversation with @cachemisses.bsky.social on an episode of *Disseminate*. Check it out!
🚨 "Fray: An Efficient General-Purpose Concurrency JVM Testing Platform" with Rohan Padhye (@rohan.padhye.org) & Ao Li (@aoli.al) is available now! 🎙️ Guest hosted by the brilliant Bogdan Stoica (@cachemisses.bsky.social) 🎧 Listen on YouTube ➡️ youtu.be/SDaTOOEDuto?...
Excited to announce that the Fray paper has been accepted to OOPSLA'25! Work led by @aoli.al with a full pastalab.org collaboration. 📄: rohan.padhye.org/files/fray-o... 💻: github.com/cmu-pasta/fray 🎥: www.youtube.com/watch?v=AX6P...
Rohan Padhye reposted
🚨 Our amazing #FUZZING'25 keynotes are online! "Constraining Fuzzing without Paying Too Much" by Miryung Kim youtu.be/L90MBb6NLBE "Are you sure you belong in academia?" by Will Wilson youtu.be/qQGuQ_4V6WI // @mboehme.bsky.social, László Szekeres, @rohan.padhye.org, @ruijiemeng.bsky.social
We had two exciting keynotes: * From academia: Miryung Kim (Prof @ UCLA) * From industry: Will Wilson (CEO and Co-Founder of @AntithesisHQ.bsky.social). Stay tuned for recordings!
Very cool: @aoli.al uncovered a deadlock in OpenJDK that can be triggered with a tiny test case and Fray's deterministic concurrency testing & debugging support. Read his blog post here: aoli.al/blogs/jdk-bug/ If you write Java/Scala/Kotlin, try Fray yourself: github.com/cmu-pasta/fray
Just Accepted to ACM TOSEM! The "Havoc Paradox" is about the relationship between byte-level fuzzer mutations and their effect on the inputs produced by generators for structured strings (e.g. XML/SQL). Can disruptive mutations be controlled? Should they be? Find out. 📄 dl.acm.org/doi/pdf/10.1...
Rohan Padhye reposted
🖊️ Register here: ntnu.eventsair.com/fse2025-isst... (FUZZING is a co-located workshop)
We're excited to announce two keynote speakers for the #FUZZING'25 workshop (part of @issta_conf at Trondheim, Norway): [*] Will Wilson, CEO and Co-Founder of Antithesis [*] Miryung Kim, Professor and Vice Chair of Graduate Studies at UCLA conf.researchr.org/home/issta-2...
We're excited to announce two keynote speakers for the #FUZZING'25 workshop (part of @issta_conf at Trondheim, Norway): [*] Will Wilson, CEO and Co-Founder of Antithesis [*] Miryung Kim, Professor and Vice Chair of Graduate Studies at UCLA conf.researchr.org/home/issta-2...
We also have an excellent program of research talks and *fuzzing nuggets*. Detailed schedule coming soon. conf.researchr.org/home/issta-2...
Delighted to receive an ACM SIGSOFT Distinguished Award for this work... It's about time! Proud of the PASTA Lab students, including our visiting undergrads :-)
Happy Daylight Savings Time to everyone in the US! A few more weeks for European Summer Time. If you notice some of your apps glitching, don't be alarmed. Even ChatGPT can't write correct date/time code!!! See more in our upcoming paper: rohan.padhye.org/files/dateti... (MSR'25 preprint)
Submission deadline for the Fuzzing workshop is tonight (AoE)! Send us those nuggets and research ideas. Rohan
I'm super excited about this new track at the #FUZZING'25 workshop. It's the academic version of thoughtful blog posts, but with a paper and talk for wider reach! Submission deadline is in a month (March 20th)! fuzzingworkshop.github.io
Happy Daylight Savings Time to everyone in the US! A few more weeks for European Summer Time. If you notice some of your apps glitching, don't be alarmed. Even ChatGPT can't write correct date/time code!!! See more in our upcoming paper: rohan.padhye.org/files/dateti... (MSR'25 preprint)
I'm super excited about this new track at the #FUZZING'25 workshop. It's the academic version of thoughtful blog posts, but with a paper and talk for wider reach! Submission deadline is in a month (March 20th)! fuzzingworkshop.github.io
*Fuzzing nuggets* (short papers) are evidence-backed position papers or experience reports on SOTA practices---a platform for researchers & practitioners to share substantiated opinions or reflections that are of interest to the community but not to be developed into full paper.
Rohan Padhye reposted
#FUZZING'25 CALL FOR PAPERS ────── ✨ New OC members: * Ruijie Meng (@ruijiemeng.bsky.social; NUS) * Rohan Padhye (@rohan.padhye.org; CMU). ✨ New paper type: Fuzzing Nuggets (short papers). 🔗 fuzzingworkshop.github.io 📅 20.March (Submission) 📅 17.April (Notification) 📅 28.June (Workshop)
Back to basics: Concurrency testing in Java! Our new tool *Fray* correctly solves a 25+ year old problem for real-world software. See this feature from Elastic Labs about Fray's contributions to Lucene. 📰: www.elastic.co/search-labs/... 🔧: github.com/cmu-pasta/fray 📝: arxiv.org/pdf/2501.12618
How do you know whether random testing is working as expected? [1/3] Long ago in JQF, we used `assumeTrue` to bias fuzzing towards *valid* inputs. This is powerful, but the abstraction is quite coarse if you have many properties. (Refs: github.com/rohanpadhye/..., rohan.padhye.org/files/zest-i...)
[3/3] Another similarly cool idea is "events" in Tyche (by @harrisongoldste.in et al.), which is a PBT visualization extension for VSCode. We've actually integrated Tyche into JQF now so it works with Java fuzzing! Check it out. (Ref: github.com/tyche-pbt/ty..., github.com/rohanpadhye/...)
How do you know whether random testing is working as expected? [1/3] Long ago in JQF, we used `assumeTrue` to bias fuzzing towards *valid* inputs. This is powerful, but the abstraction is quite coarse if you have many properties. (Refs: github.com/rohanpadhye/..., rohan.padhye.org/files/zest-i...)
[2/3] I like the "Sometimes Assertions" abstraction recommended by Antithesis, which generalizes code coverage to user-defined predicates, possibly interleaved with application logic. Maybe we should support these in JQF too. (Ref: antithesis.com/docs/best_pr...)
Rohan Padhye reposted
And now that we’re all here, some work!🚨 Are Large Language Models Memorizing Bug Benchmarks? 🚨 There’s growing concern that LLMs for SE are prone to data leakage, but no one has quantified it... until now. 🕵️♂️ 1/
You are up to date.