Post

You may be horrified to learn that at Monash until recently (not sure if still true or not) one of the measures was, I shit you not, “Cumulative Impact Factor”, which is the *sum* of the IFs of the journal of each of your papers.

4 reposts26 likes

Wow, that's nuts. One thing I learned when my friend worked in Clarivate is that they love to sell goverments and grant orgs in developing countries, tools for metrics analysis. And then those people use these fancy tools to push the metrics down on us, so they can show numbers going up.

Oh, and for evaluations, I need to list 5 years of my papers with the journals IFs, and quartiles. Mind you, I don't have subscriptions for any of these databases

She showed it to me it was very fancy - showed the institutes best cited works, collaborators, etc. Not a suprise now that for grants I need to indicate my H indexes for Scopus, WoS, Russian citation index, how much papers in each database for the last 5 years, how many of them are Q1, etc, d naseum

Well, it's Scopus and Clarivates business, sell access to databases, yes, but also sell their tools for the database analysis. Sell it to governments - where are your best scientists? Sell it to grant orgs - what's the labs with the best ROI? Journals - which papers will do better? Etc.

And because these KPIs are hard to achieve with limited resources, you get fraudsters, publications in predatory journals, publications in borderline predatory mega journals, etc.

Yes, I am horrified. I wonder, do/did they go to the trouble to use the historical IF at the time each paper was published, or admit it's all meaningless and use the most recently made-up value?

Great question, although it's also possible to argue that at least a current impact factor might have been affected by your actual citations. Either is terrible in its own unique way!

I had a few discussions while there, but never at the highest level, which apparently dictates conditions, even to Faculty heads: fosstodon.org/@jni/1114258... Anyway, it is no longer my fight… bsky.app/profile/jni....

fosstodon.orgJuan Nunez-Iglesias (@jni@fosstodon.org)@jonny@neuromatch.social @yetiinabox@todon.nl this hits hard today, we had a town hall on research assessment at Monash Fac. of Med. Highlight was that individual article metrics were inadmissible bec...

So… um… I (and Draga Doncila Pop and Eric Perlman and @joshmoore.bsky.social and @kevinyamauchi.bsky.social) started a thing! We are excited and terrified in equal measures, and look forward to working with you all in our amazing scientific imaging community! ❤️‍🔥 Read the linked post for the lowdown.

It's sweet that you would think that this might be surprising. Outside of the science evaluation reform bubble, this (& other similar metrics) is exactly the kind of total nonsense that is still systematically and broadly used to evaluate research, people & institutions.

I’ve heard the same thing being done officiously in France (despite Inserm and CNRS adhering to DORA on paper). To add to the non sense, also weighting depending on author position and shared first/last; eg dividing the IF by number of co first authors, mechanically penalizing collaborative efforts😩