Blair Shevlin

Blair Shevlin

@bshev.bsky.social

Faculty @ Icahn School of Medicine. Computational Psychiatry. Neuroeconomics. Decision-Making

517 followers504 following53 posts

Blair Shevlin reposted

BayesFlow 2.1.0 is now live! 🚀 Our new major release includes lots of goodies: differentiable adapters, better inference network featuring Mean Flow, unified masking, redesigned multilevel inference, and much more! 🎉 The sky is the limit. And as always, keep rocking! 😎 github.com/bayesflow-or...

github.comGitHub - bayesflow-org/bayesflow: A Python library for simulation-based inference with deep learningA Python library for simulation-based inference with deep learning - bayesflow-org/bayesflow

Blair Shevlin reposted

📢 New paper 📢 I am excited to report that our paper 'Transdiagnostic factors differentially shape choices and decision times in social evaluative learning' is now published Open Access in Psychological Medicine! 1/5

Blair Shevlin reposted

I’m hiring a postdoc in my lab at the University of Amsterdam! Interested in mathematical psychology, evidence-accumulation models & Bayesian hierarchical modeling? Join us to develop new models of cognitive fluctuations across multiple timescales. Please share! werkenbij.uva.nl/en/vacancies...

werkenbij.uva.nlVacancy — Postdoctoral Position in Modeling Cognitive FluctuationsCurious about why cognitive abilities fluctuate over time? Interested in using cognitive models and Bayesian hierarchical approaches to tackle complex, real-world data? Join this ERC-funded project to...

Blair Shevlin reposted

Blair Shevlin reposted

Now out in PNAS. We show that AI detection failure rates vary and are platform-specific. Agents without knowledge of the tests were caught every time, while sophisticated agents with knowledge of the tests could evade detection only at nearly 3x the time and 6x the cost. www.pnas.org/doi/10.1073/...

pnas.orgEstimating the threat of AI-agent responding across online survey platforms | PNASRecent research and advances in LLMs have led to widespread concern that AI agents could pose as human online survey-takers. However, it remains un...
Oleg Urminsky@olegurminsky.bsky.social

When you collect data online, are the results from humans or AI? In a project led by Booth PhD student Grace Zhang, we estimate the prevalence of AI agents on commonly used survey platforms: osf.io/preprints/ps... 🧵

Blair Shevlin reposted

📢 My lab at the Mount Sinai School of Medicine is considering graduate student applications this fall! We welcome applicants interested in using computational modeling to study social interaction 🗓️ Deadline: December 1, 2026 🔗 Learn more: sinclaboratory.com/apply #comppsychiatry #socialneuro

Blair Shevlin reposted

Replying to @nsehgal.bsky.social

One last worrying finding: AI-assisted submissions were approved 99.6% of the time, basically as often as unassisted submissions (99.7%). In 60 cases where we directly observed instructions explicitly banning AI, all 60 were still approved and paid.

Blair Shevlin reposted

🚨 New paper 🚨 Are your participants using AI to take your study? We conducted the first study directly observing AI assistance in online research, spanning 700K+ Prolific submissions. We found very rare, concentrated AI use, but gaps in safeguards. arxiv.org/abs/2610.09279

Blair Shevlin reposted

Blair Shevlin reposted

Blair Shevlin reposted

⚡ Out now: Psychological and health sciences increasingly study how phenomena dynamically influence and reinforce one another over time: for example, to understand the mechanisms maintaining mental disorders. Can we identify reliable clusters of these dynamics? A thread 🧵 osf.io/preprints/ps...

Blair Shevlin reposted

Moral and perceptual decisions may share computational mechanisms, but do they rely on the same neural systems? This study shows that both follow similar evidence-accumulation computations, yet engage distinct neural representations. 🧪 #NeuroSky #morality #cognition plos.io/4AM2V57

Blair Shevlin reposted

nature.comMetabolic and neural responses to ultraprocessed foods: a randomized, controlled, crossover studyThe full study comprised 57 participants; of these, 32 completed both metabolic sessions in a randomized crossover design and 52 completed the functional magnetic resonance imaging (fMRI) session (Extended Data Fig. 1). Every participant who completed the metabolic sessions also completed the fMRI session. The overall participant sample was 31.6% male, with a mean age of 26.21 ± 6.85 years and body mass index (BMI) of 22.75 ± 1.87 kg m−2 (Extended Data Table 1). Participants’ habitual energy intake on average comprised 54.4 ± 18.4% UPFs, similar to the national average of 55.0% (ref. 2). Additional participant characteristics are described in Extended Data Table 1. Exclusions and final analytic samples for each modality are summarized in the CONSORT diagram (Extended Data Fig. 1). Acute metabolic effects of UPFs and non-UPFs To investigate the effect of processing level on post-ingestive metabolic response to foods with matched nutrient content, 32 participants consumed, and were required to finish within 10 min, ~300 kcal nutritionally matched meals composed entirely of either UPF or non-UPF while undergoing 4 h (50 min baseline followed by a 3 h postprandial period) of whole-room indirect calorimetry (WRIC) and concomitant blood collection by intravenous catheter (Fig. 1a). The non-UPF...

Blair Shevlin reposted

Some months ago, I wrote a skeptical reply to a commentary on bots in online studies in PNAS, arguing that no evidence yet exists for such bots. Together with the authors of the original commentary, we now show that bots can pass (almost?) all online cognitive studies with human-like performance 1/n

Christoph Strauch@cstrauch.bsky.social

How much of a risk are LLM-generated bots for online behavioral experiments? We present results of an entirely natural language prompt-generated agent, capable of absolving any of the 26 experiments we tested it on. Most tasks are passed with data that can pass as human osf.io/preprints/ps... (1/)

View full thread

Our main takeaway: when mood drops, taste may take over the decision process in women with BN, which could help explain the shift from restriction to binge eating. We hope this points toward new targets for intervention.

View full thread

Participants with BN let taste information into the decision earlier than health information, more so than controls. And under negative mood, this taste bias got stronger!

Importantly, the size of this mood-driven taste bias tracked with how many binge episodes people self-reported over the past three months.

View full thread

The mood induction worked: everyone felt worse afterward. But choices didn't change. That's where we came in. Focusing on choices alone can hide how a decision unfolds.

We fit a cognitive model (a sequential sampling / diffusion decision model) that tracks when different attributes, like taste and health, enter a decision as it's being made.

View full thread

But outside of binges, the same people typically restrict their eating and avoid high-fat foods. Why the flip? That's what we set out to understand.

In earlier work, our Columbia colleagues had women with BN and matched controls rate foods for taste and healthiness, then make food choices, after both a neutral and a negative mood induction (on separate days).

Bulimia nervosa (BN) is closely tied to negative mood. People often report emotional distress right before a binge, and binges typically involve highly palatable, high-fat foods.

Blair Shevlin reposted

How much of a risk are LLM-generated bots for online behavioral experiments? We present results of an entirely natural language prompt-generated agent, capable of absolving any of the 26 experiments we tested it on. Most tasks are passed with data that can pass as human osf.io/preprints/ps... (1/)

Blair Shevlin reposted

NEW: The anterior hypothalamic nucleus acts like a volume knob for stress, scaling the brain’s response to threatening events 🧠 Read the Cai Lab's latest paper, led by @zachtpennington.bsky.social, in @nature.com 🎉 www.nature.com/articles/s41... More: bsky.app/profile/did:...

Denise J. Cai, Ph.D.@denisejcai.bsky.social

❓ Do you know what the anterior hypothalamic nucleus (AHN) does? No? Neither did we! 🧠 In a new preprint from the Cai Lab, learn how we discovered the AHN’s central role in regulating stress vulnerability. Read the paper here: www.biorxiv.org/content/10.1... (1/6)

Blair Shevlin reposted

Replying to @fredcallaway.bsky.social

I think it comes down to opportunity cost. In our recent paper (Zhang et al., PNAS, cond. accepted), data from a few months ago suggest some people are already doing this (caveat: some may be non-compliant humans, and things move fast).

Blair Shevlin reposted

I just had Opus 5.5 one shot a Human-Like mousetracking driver by looking at my code on cognition. Right now it's choosing left or right randomly. It's still not perfect but this took it literally a simple prompt and 1.5 mins to code a script. It can then be randomized and used across bot accounts.

Like I've been saying - many of the tools we've been using for bot detection are no match for today's LLM agents. We need to work together to build new standards!

Heather Urry@heatherurry.io

holy fucking shit - see Claude Code (Opus 5.5) rip through a survey eligility test I was really proud of... It requires tracing a route through designated points on a map with server-side Javascript applying eligibility criteria. (1.5 min video)

Blair Shevlin reposted

Blair Shevlin reposted

Tired of the centrality debate? Of seeing one application where centrality is influential & others where it's more arbitrary? We have the article for you: osf.io/preprints/ps... Turns out centrality can indeed matter; but when it does depends on underlying network structure & mechanism of spread 🧵

Been raising that alarm internally at Sinai and Yale, but if our field wants to continue to rely on virtual data collection then we need to develop better bot detection tools. Glad to be collaborating with @kiante.bsky.social on these efforts. His work at UCLA is leading the way survey-shield.com

survey-shield.comSurvey ShieldSurvey Shield - AI-powered survey bot-detection analysis
Micah G. Allen@micahgallen.com

So… we just found out that GPT sol can complete a complex online behavioral/cognitive study producing nearly indistinguishable behavior and subjective reports… right as we are about to launch. Is this doomsday for online cognitive testing?

Blair Shevlin reposted

Blair Shevlin reposted

📣 NEW PREPRINT ALERT! 📣 📝Preprint: www.biorxiv.org/content/10.6... When choosing between options with multiple attributes, what does the brain actually compare - individual attributes or integrated option values? We combined EEG + eye-tracking to find out... and found evidence for the latter 🧠

biorxiv.orgFixation-evoked potentials reveal neural signatures of hierarchical value-integration during decision-makingMany decisions require maintaining beliefs across multiple levels of representation, from sampling and integrating information to forming action plans. To elucidate these processes and reveal the neur...

Incredibly excited to host this event next week! Dr. Rust's work is both rigorous and inspiring

The Friedman Brain Institute@sinaibrain.bsky.social

ONE WEEK AWAY! On Thursday, September 24, 1pm, the #FBISeminarSeries and host Dr. @bshev.bsky.social welcome @upenn.edu's Dr. @nicolecrust.bsky.social. Dr. Rust will present "From Subjective Feelings to Brain Mechanisms: Advancing the Science of Mood through Epistemic Iteration". ✨NOT TO MISS!