Quan Ze Chen

Quan Ze Chen

@cqz.name

124 followers37 following9 posts

Quan Ze Chen reposted

Quan Ze Chen reposted

Quan Ze Chen reposted

Can LLM prompting help social media users create and iterate on their content filters more easily? In our #CHI2025 paper, we compared in an experiment three authoring strategies: 🤖 Prompting LLM 🔎 Labeling examples for ML classifiers 📐 Authoring keyword rules (🧵1/N)

In-context learning can be an effective way to conduct value alignment of LLMs through examples, but when there are multiple pluralistic groups, are the best examples for one group also the ones for another? We explore this in our paper 🌟SPICA🌟 (🧵1/9)

View full thread

With SPICA, we show the need to not only capture preferences, but also recognize and prioritize norms when it comes to in-context pluralistic alignment. (8/9)

In-context learning can be an effective way to conduct value alignment of LLMs through examples, but when there are multiple pluralistic groups, are the best examples for one group also the ones for another? We explore this in our paper 🌟SPICA🌟 (🧵1/9)

View full thread

In-context learning can be an effective way to conduct value alignment of LLMs through examples, but when there are multiple pluralistic groups, are the best examples for one group also the ones for another? We explore this in our paper 🌟SPICA🌟 (🧵1/9)

View full thread

In SPICA, we sample **individual preferences** of members in a group to create metrics inspired by social norm theory that inform us of how each group prioritizes which examples they care more about (best illustrates group norms) (4/9)

We then make use of these metrics during the retrieval process, producing pluralistically aligned examples that both reflect group preferences, and also their norms. (5/9)

In-context learning can be an effective way to conduct value alignment of LLMs through examples, but when there are multiple pluralistic groups, are the best examples for one group also the ones for another? We explore this in our paper 🌟SPICA🌟 (🧵1/9)

Traditional in-context alignment (ICA) retrieves demonstration examples (query & answer) by finding those most similar to a new query. However, when there is a plurality of groups to align to, the same queries get picked regardless of group. (2/9)

We argue that group level differences extend beyond their preferences for how to answer, and that different groups can also have preferences around which queries are better examples of how they prioritize their values. (3/9)

Quan Ze Chen reposted

How can we help communities collaboratively shape policies that impact them? In our #CHI2025 paper, we present PolicyCraft, a system that supports ✨collaborative policy design✨ through case-grounded deliberation. (🧵/11)

Quan Ze Chen reposted

Our lab has three paper talks at CSCW! But I want to highlight this one because @cqz.bsky.social is on the job market this year!! He works in crowdsourcing and human-AI systems. Make sure to check out his presentation on Wednesday. arxiv.org/abs/2305.01615

arxiv.orgJudgment Sieve: Reducing Uncertainty in Group Judgments through...When groups of people are tasked with making a judgment, the issue of uncertainty often arises. Existing methods to reduce uncertainty typically focus on iteratively improving specificity in the...
Amy Zhang@axz.bsky.social

Excited to head to CSCW ‘23 later today! I’m only going to be there Monday bc of teaching so I plan to just hang out somewhere in the open spaces to meet ppl, come say hi :)

You are up to date.