Post

1/ I suspect we are days away from hearing Elon is "using AI" to “streamline” benefits programs. You should know why fully automating decisions about who gets critical assistance is a terrible idea that will have disastrous consequences. A 🧵 based on work I’ve done with the great @awhf.bsky.social

nytimes.comMusk Allies Discuss Deploying A.I. to Find Budget SavingsA top official at the General Services Administration said artificial intelligence could be used to identify waste and redundancies in federal contracts.

2/ AI tools can help long-understaffed and underfunded agencies quickly process lots of data and respond with greater speed to the needs of constituents. BUT careless & punitive design and implementation of these tools have often prevented benefits from reaching the people they’re intended to help.

5/ And in Michigan, a new automated system for detecting fraud in unemployment insurance claims identified fivefold more fraud compared to the older system—causing some 40,000 people to be wrongly accused of unemployment insurance fraud.

wlr.law.wisc.eduAutomated Stategraft: Faulty Programming and Improper Collections in Michigan’s Unemployment Insurance ProgramA consistent critique about public benefits programs is the idea that they may be ripe for fraud. To combat this concern, states contract with third-party companies to develop coding for their program...

9 reposts32 likes

6/ These programs aren't perfect, and oversight is critical. But these cases show how tech systems keep qualified people away from help. They are the modern face of an old problem: The U.S. has long put up administrative burdens to deter the poorest applicants from making use of government help.

7/ The New Deal–era distinction between “earned” social benefits—like Social Security—aimed at working white men, and social assistance programs for the poor has translated over time to especially high barriers for the Americans most in need. AI now turbocharges this restrictive approach.

8 / Before ChatGPT, Virginia Eubanks showed how child welfare, social assistance, and law enforcement agencies were using faulty and biased AI to make decisions affecting vulnerable communities. Her prescient work shows the result: a system plagued not by oversubscription, but by chronic underuse.

us.macmillan.comAutomating InequalityWINNER: The 2019 Lillian Smith Book Award, 2018 McGannon Center Book Prize, and shortlisted for the Goddard Riverside Stephan Russo Book Prize for Social Jus...