Alex Chohlas-Wood

Alex Chohlas-Wood

@alexchohlaswood.com

Assistant professor at NYU interested in computational public policy and the criminal justice system. Co-direct @comppolicylab.bsky.social.📍NYC 🏳️‍🌈 alexchohlaswood.com

646 followers759 following66 posts

Pinned

Have you ever forgotten an important date—like a birthday for a loved one? Now imagine if forgetting meant ending up in jail. Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.

Alex Chohlas-Wood reposted

For @brookings.edu, three members of our Task Force on AI wrote about the need for state-level regulation of AI use for criminal justice. More 👇 from @alexchohlaswood.com @chiraagbains.bsky.social, and Katie Kinsey (@policingproject.bsky.social) www.brookings.edu/articles/sta...

brookings.eduStates can—and should—regulate AI in criminal justice | BrookingsStates should set guardrails around AI use in criminal justice, but an executive order from President Trump threatens to chill such efforts.
Alex Chohlas-Wood@alexchohlaswood.com

In an age of rapidly evolving AI, we are *just* starting to learn how we can properly regulate these powerful new technologies. While many new regulations will be well-intended, we won't know what really works until we try many different approaches.

In an age of rapidly evolving AI, we are *just* starting to learn how we can properly regulate these powerful new technologies. While many new regulations will be well-intended, we won't know what really works until we try many different approaches.

View full thread

In an age of rapidly evolving AI, we are *just* starting to learn how we can properly regulate these powerful new technologies. While many new regulations will be well-intended, we won't know what really works until we try many different approaches.

That's why it's critical to allow all fifty states the flexibility to choose their own regulatory path — so that we can scale those that work, and move on from those that don't.

.@counciloncj.org just released a comprehensive guide to help justice agencies make the right decision about whether and how to adopt AI. This guide reflects many productive discussions we've had on the Task Force for AI over the last year—kudos to CCJ for distilling this into a practical guide!

As criminal justice agencies and practitioners face urgent questions about how to effectively and safely adopt AI tools, CCJ's Task Force on AI released a new decision guide to help stakeholders evaluate, implement, and oversee AI in the justice system. counciloncj.org/assessing-ai...

Alex Chohlas-Wood reposted

View full thread

You might think that you'd need detailed police deployment records to answer this question. Getting this information via a public records request could take months, and may be denied by the department altogether.

Have you ever forgotten an important date—like a birthday for a loved one? Now imagine if forgetting meant ending up in jail. Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.

View full thread

Have you ever forgotten an important date—like a birthday for a loved one? Now imagine if forgetting meant ending up in jail. Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.

View full thread

Reminders also help everyone by saving precious public resources instead of paying for these wasteful jail stays. The reminders themselves cost about 60¢ per case—less than the costs of paying for someone’s arrest and incarceration, even for a single night.

Reminders alone are unlikely to dramatically reduce overall jail populations, as jail stays for missed court dates are often short. But stacking them with other small, common-sense reforms could substantially improve our justice system.

Have you ever forgotten an important date—like a birthday for a loved one? Now imagine if forgetting meant ending up in jail. Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.

View full thread

Court date reminders may seem small, but they make a big difference. Our study was conducted with public defender clients who can’t afford a lawyer. These nudges are a huge boon for low-income clients, helping them avoid the high costs of a disruptive stay in jail.

We found that a broad swath of clients appeared to benefit from reminders—even people facing low-level charges. Think of a DUI case: make a bad mistake one night, then forget a court date, and suddenly you’re in jail for a few days. A minor case just became much more serious.

Have you ever forgotten an important date—like a birthday for a loved one? Now imagine if forgetting meant ending up in jail. Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.

Calling all professors—we're enrolling new courses in our ongoing randomized study of AI in education! Get free access to a customized virtual tutor, and receive an honorarium at the end of the semester if you participate. Details below.

Instructors at 2- and 4-year colleges! Give your students free access to a virtual tutor optimized for learning by taking part in our study on using AI to improve education. Instructors receive a $1,000 honorarium. Apps received by 8/8 receive priority: pingpong.hks.harvard.edu/eduaccess

Come join us and teach a great class this fall!

Daphna Harel@daphna.bsky.social

NYC-based people - I'm looking for an adjunct instructor to teach an undergraduate course *this fall* at NYU called Power and Politics of Data. There's a lot of flexibility in what the course could look like, but I'm also happy to share ideas and the job ad. DM me if you think you're interested.

Alex Chohlas-Wood reposted

Replying to @alexchohlaswood.com

Yes to evaluating the *outcomes* of these systems rather than as a standalone algorithm! This is something that's been bothering me for a while about ML assisted decisions

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

Ultimately, we’ll likely achieve better outcomes if we think of algorithms as *policies* — and design them in a way that aims for the specific policy goals we desire. (17/17) bsky.app/profile/alex...

Alex Chohlas-Wood@alexchohlaswood.com

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

We use data from the Santa Clara County Public Defender to show that this approach would result in higher utility: - During the learning phase AND - After we stop learning! Of course, this approach applies in any resource-constrained setting, not just for rides to court! (14/)

Many studies have framed fairness as a mathematical problem, proposing axioms without considering the consequences. In contrast, our approach: - Focuses on outcomes - Devises a computational framework for learning to be fair in an efficient and cost-effective manner (15/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

But randomized controlled trials are costly in a couple ways. First, people who would really benefit from a ride might be excluded if they’re randomized to a control arm. Second, we might waste money on rides for people who don’t need transportation assistance. (12/)

The framework we designed uses contextual bandits and optimization to: - Learn how people respond to rides, and then provide rides to people who need them—even while we’re still learning - Equitably allocate rides by modeling preferences as parameters in a convex objective (13/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

This suggests that there’s no one-size-fits-all definition of fairness. Instead, we should make decisions in a way that reflects our preference for how to make difficult tradeoffs. (In practice, one could run a survey like the above to elicit preferences from people.) (10/)

How could we make decisions like this in the real world? One approach would be to run a randomized controlled trial to learn how people respond to rides. We could then estimate the tradeoffs at hand, and choose an tradeoff that best reflects our preferences. (11/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

Fortunately, we don’t have to follow only one of these approaches. We could instead balance between these approaches in a way that feels most fair. But “what feels fair” is ultimately a matter of personal preference, and depends on the exact tradeoff in question. (8/)

To illustrate, we asked 300 Americans how they would make this tradeoff. After explaining the problem, we let them choose their preferred outcome. Most people preferred an outcome other than demographic parity—even people in the same political party! (9/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

It might seem wrong to exclude most Black and Hispanic residents like this. So what should we do? We could instead provide a ride to an equal share of court attendees from every neighborhood. (For researchers in ML fairness, this is akin to imposing demographic parity.) (6/)

This would reduce disparities in who gets a ride. But there would be real drawbacks! - We’d pay for longer rides to court, so - We’d provide fewer rides overall, so - More people would go to jail for missing court. In other words, there’s an inherent tradeoff at play. (7/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

View full thread

So we’d have to choose who gets a ride. A natural way to do this would be to select people who: a) Wouldn’t attend normally, but would attend if provided a ride b) Live close to court, so the ride is cheap This would maximize court appearances given our budget. Seems good! (4/)

But there’s a catch! Take Boston as an example. In prioritizing cheap + short rides, imagine that we drew from people who lived close to the courthouse (like in the map). By trying to be efficient with our budget, we’d exclude many Black + Hispanic residents of Boston. (5/)

NEW in Management Science! My coauthors and I came up with a new consequentialist approach to designing equitable algorithms. Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes. More in the 🧵 below! (1/)

Imagine a government initiative that aims to improve court attendance rates. In other research, we’ve already shown that sending automated court date reminders can increase court appearance rates and reduce pretrial incarceration. (2/) bsky.app/profile/alex...

Alex Chohlas-Wood@alexchohlaswood.com

In a new randomized experiment at the Santa Clara County Public Defender Office, my colleagues and I found that text message reminders reduce *incarceration* for missed court dates by over 20%! More in the 🧵 below. alexchohlaswood.com/assets/paper... 1/11

What if we wanted to improve court attendance rates even more? One possible initiative would be providing people with free rides to court. But with a limited budget, we wouldn’t have enough funding to give everyone a ride. (3/)

Alex Chohlas-Wood reposted

The use of race in clinical risk models is heavily debated. While race-aware models can be more accurate, some are concerned about reinforcing racialized views of medicine. In our paper, we offer a new perspective on this debate. 🧵👇https://annals.org/aim/article/doi/10.7326/M23-3166

Alex Chohlas-Wood reposted

Replying to @randomwalker.bsky.social

In AI research, more and more of the action seems to be taking place above the foundation model layer and is closer to applications / people / societal impact. This kind of research strongly benefits from interdisciplinary thinking (though not all AI researchers have recognized the shift yet!)