Post

In the context of so-called AI cancer screenings — yes, some stooges suggest apps as actual solutions — these and many other related findings, indicate that people singing the praises of such apps forgot basic stats: > the balance of benefits and harms including overdiagnosis should be reconsidered

doi.org92 Systematic review of overdiagnosis in cervical cancer screening: how should we define overdiagnosis in cervical cancer screening?Objectives Cervical cancer screening is a common strategy for cancer control worldwide. Although its real target is invasive cervical cancer, the incidence has not been high in developed countries, an...

Many who push AI solutionism here (and elsewhere) propose that cancer screenings using AI can be "fixed" by collecting more "diverse” (whatever that means) data. This implies datafication is good or even always good maybe and that these models are actually useful so long as we remove the racism...

The problem is not just that a model is racist it's also that there is no reason to assume that we should extract that data, from vulnerable groups, think of HeLa, Tuskegee, these things do not end well, from e.g. Black people (patients!) and put their data into what? An app owned by a company?

There is no reason to assume the model is actually as accurate as it seems for people whose data is included as this is just a snapshot in time of cancers — and importantly a snapshot during which there are still skilled technicians & doctors. If we deskill those professions such tech might fail!

When AI proponents who frame statistics in this solutionist way are using "cancer: we also must detect that it is a rhetorical sleight of hand to obscure that often seemingly technical apps are created NOT for medical altruistic reasons but FOR profit. (Also see blue box at the link.)

ainowinstitute.org3: Consulting the Record: AI Consistently Fails the Public - AI Now InstituteAmid the excitement over AI’s (speculative, hypothetical) potential, we have lost sight of the sobering reality of its present and recent past. AI is already intermediating critical social infrastruct...

As you know, this is something the pharmaceutical industry is known to do and is worthy instead of extreme regulation (think of Theranos, Palantir, etc). So much so in fact that journals are unable, even though they claim they want to, keep their pages free from tobacco industry propaganda!

doi.orgTobacco funded research: how even journals with bans find it hard to stem the tide of publicationsTobacco companies are investing billions in pharmaceutical and medical products. These ties complicate the ongoing efforts of researchers, scientific organisations, and journals to distance themselves...

Lack of addressing these issues makes claims of caring about cancer by AI stooges unrealistic: they are just selling their nonsense instead. Uncritically taking the frames of people who want to flog terrible apps and want to trick us into giving them, e.g. Black people’s, medical data seems unwise.

PS: also relevant h/t @markdingemanse.net > I argue that prediction is not primarily a technological means for knowing future outcomes, but a social model for extracting and concentrating discretionary power. Prediction is a ‘relational grammar’ that governs this allocation of discretion

doi.orgSage Journals: Discover world-class researchSubscription and open access journals from Sage, the world's leading independent academic publisher.

2 reposts14 likes

No replies yet.