Yoshitomo Matsubara reposted
Yoshitomo Matsubara
Yoshitomo Matsubara
@yoshitomo-matsubara.net
Sr. Research Scientist at Yahoo! / ML OSS developer PhD in Computer Science at UC Irvine Research: ML, NLP, Computer Vision, Information Retrieval EiC: TMLR Technical Chair: CVPR, ECCV, ICCV, WACV Open Source/Science matters https://yoshitomo-matsubara.net
1.5K followers184 following491 posts
Yoshitomo Matsubara reposted
How do you tell if authors fabricated their research results? Sometimes: they just tell you. Read, e.g., this caption carefully. Another banger of a post by my friend Nihar B. Shah on his blog, where he found at least 20+ such #ICLR2027 submissions: researchonresearch.blog/2026/10/20/s...
We posted an article about what we're doing under 300% increase in submissions For example, we desk-reject a lot of papers before we assign AEs to submissions Our recent data suggest about 90% of desk-rejections are done by EiCs There are more items to learn. Check it out! 👀
What is TMLR doing under a 300% increase in submissions? - Suspensions of >150 authors - Publicly naming major violations - Submission quotas distinguishing slop patterns - Desk rejections 6% → 53%; focus on clarity - AI reviews evaluating soundness blog.tmlr.org/2026/adaptin...
Looks so fun! though I'm afraid that I'm outlier here😂 My 9 games #My9Games www.my9games.net/en/share/3d2...
Ok, my turn: My 9 games #My9Games www.my9games.net/en/share/5de...
Yoshitomo Matsubara reposted
Thanks @paulvicol.bsky.social for building the nice blog! 👏 Our previous Medium posts were migrated to the new blog Time to say goodbye to our legacy Medium blog 👋
TMLR now has a shiny new blog! By popular demand, the days of Medium are over. All the old posts are already ported, please check it out (and its beautiful colour scheme). Thanks to Managing Editor @paulvicol.bsky.social for setting it up! blog.tmlr.org
Yoshitomo Matsubara reposted
Nihar Shah did a heroic experiment for TMLR: he spent 20-25 hours over two weeks interviewing authors of seemingly low-quality submissions about their own papers. He confirmed what we all suspected: people submitting these papers have *no idea* what is going on in them.
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/ask...
Do authors understand their own papers? Our desk rejection rate at TMLR is about 53% while it was only 6% in 2023 To understand the situation and assess our process, Nihar asked authors about their own TMLR submissions Learn the findings of the pilot study & share your thought
TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/ask...
Another great initiative to make the review process sustainable, this time from NLP community TBH, I am not certain yet that a lottery would work out. 20-submission cap sounds too much I like ideas to support those who need it such as mentorship🤗
ACL Sustainable Reviewing Policy: We are introducing changes in the @ReviewAcl reviewing and submissions. The changes will cap authors and introduce changes in the reviewing to keep our community sustainable. #NLProc #NLP
I was interviewed by @jeffreybrainard.bsky.social from Science about "AI peer-review" and shared my experience Science published his article yesterday. While I found many of the names mentioned in the article familiar, I learned a lot from it Check it out and share your thoughts!
As research papers proliferate, can AI reviewers help humans check quality while keeping pace with the flood? Tests are revealing their strengths and weaknesses. #PeerReviewWeek @science.org www.science.org/content/article/can-ai-help-solve-peer-review-crisis-here-are-its-promises-and-pitfalls
I like the #ICLR2027 submission policies and strongly support them "The deanonymization policy" is my favorite Personally, I think all major AI/ML-related conferences should follow that in this era The submission cap can be even lower, say 10 or even 5 from next year blog.iclr.cc/2026/09/02/s...
Yoshitomo Matsubara reposted
TMLR has refocused its acceptance criteria to place more emphasis on clear writing. Read more in this blog post: medium.com/@TmlrOrg/inc...
Again, I like the preliminary meta-review experiment #NeurIPS2026 Yet, I don't understand why ACs need to edit the existing meta-review field including "Final meta-review update:" AND then fill "Final Justification" field Those two fields seem almost identical to me
Finished all initial meta-reviews for #NeurIPS2026 E&D track🥱 While I'm still supportive of this experiment and potentially making it a standard, we should reduce assignments for ACs, say 4-5 papers per AC to help them do better jobs
Yoshitomo Matsubara reposted
This was a tough decision. Surveys can have value. And I think a great survey now is of higher value than ever before. But finding great surveys is increasingly reviewer labour intensive, and it's adjacent to our main scope and mission.
Starting September 1, 2026, TMLR will no longer be considering survey papers for review. This is in part due to limited reviewer resources and significant required labour for reviewing surveys, as well as the evolving role of surveys in our field.
Yoshitomo Matsubara reposted
I released torchdistill v1.1.5 last week - Reimplemented "Streamlined Knowledge Distillation" method - trackio / wandb support - FSDP/FSDP2 support - "accumulation mode" for forward hook manager and more github.com/yoshitomo-ma...
Kudos to #ICLR2027 PCs for taking strong actions 👏 I like they keep it open to new people, mitigating a risk of "AI slop" Submission cap should be much lower, say 5 papers per author, unless their contribution is significant and they offer quality review workforce accordingly
ICLR 2027 has authorship quotas: - No more than 20 submissions per author - No more than 1 submission where no author has a paper previously accepted to a major ML conference From iclr.cc/Conferences/...
Yoshitomo Matsubara reposted
Thank you to all our #ECCV2026 reviewers. Special thanks to the Outstanding Reviewers for their exceptional contributions! 👏 eccv.ecva.net/Conferences/...
Ambitious me wants to see open-source ver. instead of open-weight ver. and who will remain and/or join
Nvidia, Microsoft, Meta, Palantir and more than 20 other companies released a letter on Friday urging policymakers to avoid “premature restrictions” on open-weight artificial intelligence models that would “stifle competition or drive innovation overseas.” Full details: cnb.cx/3RwoKDJ
Yoshitomo Matsubara reposted
WACV 2027 R1 reviews are underway. Reviewers — thank you for your time. Authors — decisions land Aug 8, then rebuttals through Aug 20. Round 2 window: register Aug 20, submit Aug 27 (AoE). wacv.thecvf.com/Conferences/... #WACV2027 #ComputerVision
Finished all initial meta-reviews for #NeurIPS2026 E&D track🥱 While I'm still supportive of this experiment and potentially making it a standard, we should reduce assignments for ACs, say 4-5 papers per AC to help them do better jobs
Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well
It may not be a new problem, but amplified by "AI-generated" artifacts People pursue "good points" e.g., paper accepted / served at top venues and tend to close their eyes to "bad points" e.g., accountability for their papers, reviews, and consuming/wasting community resource
Radical proposal: if you want to submit your work for review by other humans, it must first be publicly and permanently posted somewhere with your name on it.
Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well
#ICML2026 appeal failed 1. Escalated reviewer's policy violation to AC 2. AC kept silent 3. Escalated it to track chairs 4. Chairs kept silent 5. AC did the same violation in meta-review 6. Reminded chairs 7. Chairs got defensive, didn't acknowledge any What's the last resort?
Excited and honored to serve as a (Co-)Editor-in-Chief of @tmlrorg.bsky.social with great EiCs to run TMLR and improve its peer review system! It was not on my bingo card, but a surprising journey '21: Beta tester '23: First paper accepted '24: Reviewer '24-'26: Action Editor '26-: Co-EiC🆕
We're pleased to announce our newest Editor-in-Chief, Yoshitomo Matsubara (@yoshitomo-matsubara.net)! He started his term July 1, 2026. He has long been one of our most committed and thoughtful Action Editors, and we know he'll do a great job as a leader of the journal.
Yoshitomo Matsubara reposted
📢 ARR May 2026 cycle update We have published a blog post about the increased review assignments in the May cycle, what happened, and what comes next. Please read the full post here: aclrollingreview.org/may26-cycle-... #ARR #ACL #NLProc