Yoshitomo Matsubara

Yoshitomo Matsubara

@yoshitomo-matsubara.net

Sr. Research Scientist at Yahoo! / ML OSS developer PhD in Computer Science at UC Irvine Research: ML, NLP, Computer Vision, Information Retrieval EiC: TMLR Technical Chair: CVPR, ECCV, ICCV, WACV Open Source/Science matters https://yoshitomo-matsubara.net

1.5K followers184 following491 posts

Yoshitomo Matsubara reposted

As in previous years, TMLR will pause new submissions over the upcoming holiday period from November 30, 2026 at 11:59 PM to January 3, 2027 at 11:59 PM (AoE timezone for both). We will resume accepting new submissions on January 4, 2027. Happy Holidays!

I see some claimed on social media that some #ICLR2027 submissions were desk-rejected due to CoI Where did they come from? Is it really CoI? Unless assignments were manipulated in bad faith (e.g., collision rings), it sounds baseless or like misleading

We posted an article about what we're doing under 300% increase in submissions For example, we desk-reject a lot of papers before we assign AEs to submissions Our recent data suggest about 90% of desk-rejections are done by EiCs There are more items to learn. Check it out! 👀

What is TMLR doing under a 300% increase in submissions? - Suspensions of >150 authors - Publicly naming major violations - Submission quotas distinguishing slop patterns - Desk rejections 6% → 53%; focus on clarity - AI reviews evaluating soundness blog.tmlr.org/2026/adaptin...

As an OSS maintainer, how would you feel when you see an seemingly autogenerated "bug report" as a GH issue at your repo? Bonus: you learn the same user did the same for many repos in last few hours

Yoshitomo Matsubara reposted

🚀We have PhD openings in my lab! 3D got pretty interesting :) Generation is getting better, which makes real scenes more interesting: things get used, opened, moved, etc We want to understand that in 3D: function, dynamics, physics 👉apply 3dunderstanding.org/openings.html or via ELLIS

Thanks @paulvicol.bsky.social for building the nice blog! 👏 Our previous Medium posts were migrated to the new blog Time to say goodbye to our legacy Medium blog 👋

TMLR now has a shiny new blog! By popular demand, the days of Medium are over. All the old posts are already ported, please check it out (and its beautiful colour scheme). Thanks to Managing Editor @paulvicol.bsky.social for setting it up! blog.tmlr.org

Yoshitomo Matsubara reposted

Nihar Shah did a heroic experiment for TMLR: he spent 20-25 hours over two weeks interviewing authors of seemingly low-quality submissions about their own papers. He confirmed what we all suspected: people submitting these papers have *no idea* what is going on in them.

TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/ask...

Do authors understand their own papers? Our desk rejection rate at TMLR is about 53% while it was only 6% in 2023 To understand the situation and assess our process, Nihar asked authors about their own TMLR submissions Learn the findings of the pilot study & share your thought

TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/ask...

Another great initiative to make the review process sustainable, this time from NLP community TBH, I am not certain yet that a lottery would work out. 20-submission cap sounds too much I like ideas to support those who need it such as mentorship🤗

ACL 2027@aclmeeting.bsky.social

ACL Sustainable Reviewing Policy: We are introducing changes in the @ReviewAcl reviewing and submissions. The changes will cap authors and introduce changes in the reviewing to keep our community sustainable. #NLProc #NLP

View full thread

#ECCV2026 Day 3 Another day with a full of discussions towards next conferences and some prizes (T-shirt and VIP party) Unfortunately, I have to leave here tomorrow and go back home It was a little bit short, yet a fruitful time for me🤗 Thank you all who made those happen!

I was interviewed by @jeffreybrainard.bsky.social from Science about "AI peer-review" and shared my experience Science published his article yesterday. While I found many of the names mentioned in the article familiar, I learned a lot from it Check it out and share your thoughts!

Jeffrey Brainard@jeffreybrainard.bsky.social

As research papers proliferate, can AI reviewers help humans check quality while keeping pace with the flood? Tests are revealing their strengths and weaknesses. #PeerReviewWeek @science.org www.science.org/content/article/can-ai-help-solve-peer-review-crisis-here-are-its-promises-and-pitfalls

Two weeks passed after #NeurIPS2026 meta-review deadline Nothing has happened since then. No message from PCs or SAC We still have three more weeks until the decision release Who is currently working on what? Are PCs chasing late ACs?

Is it becoming a common practice to use a rage/engagement-baity title in a paper? I feel it's unprofessional and insincere for the community Also, deflecting valid criticism as envy is next level Not citing the posts to avoid further attention being paid to the ragebait poster

Again, I like the preliminary meta-review experiment #NeurIPS2026 Yet, I don't understand why ACs need to edit the existing meta-review field including "Final meta-review update:" AND then fill "Final Justification" field Those two fields seem almost identical to me

Yoshitomo Matsubara@yoshitomo-matsubara.net

Finished all initial meta-reviews for #NeurIPS2026 E&D track🥱 While I'm still supportive of this experiment and potentially making it a standard, we should reduce assignments for ACs, say 4-5 papers per AC to help them do better jobs

Dear #NeurIPS2026 reviewers Your final justification should justify your final rating "The rebuttal addressed / didn't address my concerns." doesn't even reach the acceptable bar or help ACs write meaningful meta-reviews either Please make it more specific and JUSTIFY the score

Yoshitomo Matsubara reposted

This was a tough decision. Surveys can have value. And I think a great survey now is of higher value than ever before. But finding great surveys is increasingly reviewer labour intensive, and it's adjacent to our main scope and mission.

Starting September 1, 2026, TMLR will no longer be considering survey papers for review. This is in part due to limited reviewer resources and significant required labour for reviewing surveys, as well as the evolving role of surveys in our field.

Yoshitomo Matsubara reposted

Starting September 1, 2026, TMLR will no longer be considering survey papers for review. This is in part due to limited reviewer resources and significant required labour for reviewing surveys, as well as the evolving role of surveys in our field.

"Thank you for the rebuttal. I'll keep my score." As an AC of #NeurIPS2026 E&D track, I asked the reviewer to clarify No response so far How could authors expect them to respond if they don't even reply to an AC? We should set our bar highier and treat it highly irresponsible

I'm learning something new from a journal platform, which is new to me i.e., not OpenReview It shows me stats of reviewer activity for last X months, and there are reviewers who submitted 100 - 200 reviews in last 6 months (i.e., a review every 1-2 days) What are we doing?

Kudos to #ICLR2027 PCs for taking strong actions 👏 I like they keep it open to new people, mitigating a risk of "AI slop" Submission cap should be much lower, say 5 papers per author, unless their contribution is significant and they offer quality review workforce accordingly

Gautam Kamath@gautamkamath.com

ICLR 2027 has authorship quotas: - No more than 20 submissions per author - No more than 1 submission where no author has a paper previously accepted to a major ML conference From iclr.cc/Conferences/...

Ambitious me wants to see open-source ver. instead of open-weight ver. and who will remain and/or join

CNBC@cnbc.com

Nvidia, Microsoft, Meta, Palantir and more than 20 other companies released a letter on Friday urging policymakers to avoid “premature restrictions” on open-weight artificial intelligence models that would “stifle competition or drive innovation overseas.” Full details: cnb.cx/3RwoKDJ

Finished all initial meta-reviews for #NeurIPS2026 E&D track🥱 While I'm still supportive of this experiment and potentially making it a standard, we should reduce assignments for ACs, say 4-5 papers per AC to help them do better jobs

Yoshitomo Matsubara@yoshitomo-matsubara.net

Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well

BTW, my suspicious level on "AI-generated" reviews increased this time, which also contributed to increase in my AC workload and time for commitment Good opportunity for me to rethink solutions for the global "too many submissions for limited qualified reviewers" issue

Came up w/ a crazy idea from #NeurIPS2026 complaints Create "AI-permissive" and "Legacy/Classic" tracks, expanding the idea of ICML'26 review policy The latter uses "AI-content" detectors w/ thresholds tuned to maximize recall for papers and reviews, and takes strong actions (DR, ban, etc) WDYT?

It may not be a new problem, but amplified by "AI-generated" artifacts People pursue "good points" e.g., paper accepted / served at top venues and tend to close their eyes to "bad points" e.g., accountability for their papers, reviews, and consuming/wasting community resource

Gautam Kamath@gautamkamath.com

Radical proposal: if you want to submit your work for review by other humans, it must first be publicly and permanently posted somewhere with your name on it.

Writing initial meta-reviews for #NeurIPS2026 It's extra work for ACs, but authors can check how much effort their ACs made for the papers, and flag issues in their assessments if necessary Lazy ACs are more problematic than lazy reviewers I experienced it as an author as well

Yoshitomo Matsubara@yoshitomo-matsubara.net

#ICML2026 appeal failed 1. Escalated reviewer's policy violation to AC 2. AC kept silent 3. Escalated it to track chairs 4. Chairs kept silent 5. AC did the same violation in meta-review 6. Reminded chairs 7. Chairs got defensive, didn't acknowledge any What's the last resort?

Call for emergency reviewers #NeurIPS2026 I'm looking for two emergency reviewers: - Multimodal (text + vision) benchmark - AI for Science (text-focused) benchmark If you have experience in either domains, send me a DM including your OpenReview profile and Google Scholar links

Excited and honored to serve as a (Co-)Editor-in-Chief of @tmlrorg.bsky.social with great EiCs to run TMLR and improve its peer review system! It was not on my bingo card, but a surprising journey '21: Beta tester '23: First paper accepted '24: Reviewer '24-'26: Action Editor '26-: Co-EiC🆕

We're pleased to announce our newest Editor-in-Chief, Yoshitomo Matsubara (@yoshitomo-matsubara.net)! He started his term July 1, 2026. He has long been one of our most committed and thoughtful Action Editors, and we know he'll do a great job as a leader of the journal.

Majority of reviews I saw last 1-2 years including those I see as a #NeurIPS2026 E&D AC fall into one of the following patterns with some variations like bulleted instead of numbered Those comments come without any summary/justification for their score Do you see such a trend?

Yoshitomo Matsubara reposted