Fred Callaway

Fred Callaway

@fredcallaway.bsky.social

I study how people solve big problems with small brains. Starting at Dartmouth in 2026—I'm recruiting! https://fredcallaway.com

777 followers564 following115 posts

If you trust bar plots without labeled axes or error bars, the problem might run deeper than ChatPGT. The real lesson here is this: Don’t blindly accept data analyses, regardless of their source. People mess them up too, usually in a much harder to detect way.o

Carl T. Bergstrom@carlbergstrom.com

Your monthly reminder that if you're using ChatGPT to do your science, you're failing your colleagues, community, and all of us. Here, ChatGPT makes up data and presents it as the real thing — then apologizes when confronted.

Fred Callaway reposted

Together with other scientists I’m suing the 🇺🇸 US National Institutes of Health for violating our 1st Amendment rights & censoring our health science. I’m ready to shine a light on the darkest days. Buckle up, read on. This gets pretty wild… THREAD

ACLU@aclu.org

By terminating research grants like Kelton's to censor views it doesn’t like, the NIH is blocking scientists from work that would advance public health for all of us. We're pushing back. Tell Congress to demand the NIH restore the grants and stop its censorship campaign at aclu.org/nih_censorship_

Fred Callaway reposted

📢 My lab at the Mount Sinai School of Medicine is considering graduate student applications this fall! We welcome applicants interested in using computational modeling to study social interaction 🗓️ Deadline: December 1, 2026 🔗 Learn more: sinclaboratory.com/apply #comppsychiatry #socialneuro

Fred Callaway reposted

Trying out a live demo in the documentation site.

Josh de Leeuw@joshdeleeuw.bsky.social

I've been working on improving webcam eye tracking for 3+ years and it's nearly ready to go. After a lot of ups and downs I'm in the excited phase again after the latest validation study!

Excited to give this a spin when it’s released!

Josh de Leeuw@joshdeleeuw.bsky.social

I've been working on improving webcam eye tracking for 3+ years and it's nearly ready to go. After a lot of ups and downs I'm in the excited phase again after the latest validation study!

Fred Callaway reposted

Our paper is out in Nature Communications! In our messy, noisy world, do you find planning difficult/less worthwhile? It's not just you. As we increased the stochasticity in a planning environment, we found that people spent less effort planning: www.nature.com/articles/s41... #cogsci #planning

nature.comEnvironmental stochasticity reduces human planning effort - Nature CommunicationsThe real world is stochastic, making it difficult to know when planning is worthwhile. Here the authors show that as stochasticity increases, people spend less effort planning and adopt simpler, less ...

I think it's clear at this point that someone *could* get a bot to do online cognitive tasks without being detected. My question is: *would* anyone do this? Are cogpsych experiments (vs. surveys) really an appealing target for bad actors?

Ata Karagoz@atabk.bsky.social

I just had Opus 5.5 one shot a Human-Like mousetracking driver by looking at my code on cognition. Right now it's choosing left or right randomly. It's still not perfect but this took it literally a simple prompt and 1.5 mins to code a script. It can then be randomized and used across bot accounts.

I can't remember the last time I enjoyed a paper as much as this one. Such clear thinking. Beyond the compelling nativism-empiricism argument, it's among the best illustrations/explanations of levels of analysis I've seen. www.cell.com/trends/cogni...

cell.comThe nativist–empiricist debate is brokenThe nativist–empiricist debate has long organized cognitive science, framing cognitive mechanisms as either innate or learned. Recent advances in controlled rearing and scalable domain-general neural ...

I take great joy in using a pullout faucet to create a "whirlpool" in the pot I'm washing, with peak joy ~exponential in rotational velocity. This surely points to something deep about human cognition, but I'm not sure what.

Fred Callaway reposted

🚨New preprint with Fei Dai, @hanqizhou.bsky.social and @alisongopnik.bsky.social We extend empowerment (control over external states) by turning it inward. *Representational empowerment* asks which representations a learner should acquire and curate to solve future problems arxiv.org/abs/2609.02322

Alison Gopnik@alisongopnik.bsky.social

New paper with really interesting ideas from Fei and Hanqui, empowerment as a way of discovering representations as well as actions

Fred Callaway reposted

Excited to share the first first-author preprint of my PhD at NYU with @s-michelmann.bsky.social andDaryl Fougnie. Using eye-tracking in a novel behavioral paradigm, we reveal the mechanisms by which episodic memory (EM) and working memory (WM) interact. 🧠 doi: doi.org/10.64898/202...

doi.orgdoi.org
bioRxiv Neuroscience@biorxiv-neursci.bsky.social

Episodic memory rescues working memory via pattern separation, pattern completion, and predictive recall https://www.biorxiv.org/content/10.64898/2026.08.26.746101v1

Fred Callaway reposted

This. But I’d take it further. Most humans are most often substantially less logical and more biased than frontier models. Humans are still much smarter in many crucial ways, but internal consistency is not one of them.

Andrew Lampinen@lampinen.bsky.social

Yet another (popular) article on human/LM reasoning that (as usual) I'm deeply disappointed to see casually presupposes that humans do something called "reasoning" that's implied to be linking together steps that logically follow without any qualification, then proceeds to be dismissive 1/

Tired of doom-scrolling bluesky? Try mitpuzzles.com!

mitpuzzles.comMIT PuzzlesMIT researchers study human cognition through logic puzzles
Sam Cheyette@samcheyette.bsky.social

are you a puzzle-enjoyer, or would you like to become one? try out a game or two at mitpuzzles.com! we're trying to figure out the factors that separate novice from expert problem solving, and what changes with experience, using self-motivated puzzle solving

Fred Callaway reposted

We make flexible choices in new situations by knitting together information from separate relevant memories. But what governs which memories are retrieved and when? In a new preprint, we captured how people build decision variables from different memories by tracking their gaze on a blank screen.

biorxiv.orgFlexible decisions arise from resource-rational memory samplingFlexible decision making depends on retrieving and recombining memories. Yet because this process unfolds covertly, its governing principles remain unknown. Here we use gaze reinstatement to uncover t...

Fred Callaway reposted

How do human minds make sense of big, messy problems? 😵‍💫🌀 How do we distill complexity into something simple enough to solve? 🤔💡 We’ll be tackling these questions (and more!) at two workshops on task representations, abstractions, and construals #CogSci2026 #CCN2026 🧵 framing-the-problem.github.io

framing-the-problem.github.ioFraming the Problem — Workshop SeriesA workshop series on representation construction in cognitive science and AI. CogSci 2026 (Rio) and CCN 2026 (NYU).

Fred Callaway reposted

Fred Callaway reposted

This is an actual line that was added to the official system prompt for Codex for GPT-5.5 by OpenAI. Usually the system prompt is as minimal as possible, so I assume it would otherwise mention goblins a lot. AIs are weird.

Good read. I'd go further and suggest that scientific evidence against behaviorism is impossible in principle. Behaviorism simply says that you can model behavior as p(behavior | experience, genes). Cognitivism just adds a latent state, r (representation): p(b|e,g) = ∫ p(b|r) p(r|e,g) dr. (1/4)

Stefano Palminteri@stepalminteri.bsky.social

The more I study the issue and the original texts, the more the scientific arguments against behaviorism (and, conversely, in favor of the cognitive “revolution”) seem weaker to me. This is one of my favorite papers across all fields (and very convincing IMHO) www.academia.edu/75630727/The...

View full thread

This is not to say cognitive models aren't valuable. Going full Hofstadter, the representations in a model are themselves representations: useful ways to understand behavior and brain. This deflates Skinner's critique of cognitivism. Representations aren't true or false; they don't need evidence.

But the moment we start taking our models too seriously, we fall into the trap Skinner warned us of: believing things we have no evidence for. I think that cognitive science has largely fallen into this trap (myself included), and that we'd benefit greatly from taking Skinner's ideas more seriously.

Good read. I'd go further and suggest that scientific evidence against behaviorism is impossible in principle. Behaviorism simply says that you can model behavior as p(behavior | experience, genes). Cognitivism just adds a latent state, r (representation): p(b|e,g) = ∫ p(b|r) p(r|e,g) dr. (1/4)

Stefano Palminteri@stepalminteri.bsky.social

The more I study the issue and the original texts, the more the scientific arguments against behaviorism (and, conversely, in favor of the cognitive “revolution”) seem weaker to me. This is one of my favorite papers across all fields (and very convincing IMHO) www.academia.edu/75630727/The...

This representation parameterization is useful because it (1) tends to generalize better and (2) is more interpretable. But this is just data-efficiency and aesthetics. These properties cannot provide *evidence* against behaviorism. And they provide weak (if any) evidence for the representation.

I'm most proud of Chapter 3, which provides a new formal definition of resource rationality: it's an interpolation between constrained optimization (bounded optimality) and cost-benefit tradeoffs (metalevel rationality, e.g. EVC). The word "resource" turns out to be critical.

Fred Callaway reposted

Convincing evidence that people recall individual past experiences to inform decisions—specifically when an easier incremental learning strategy isn’t available. Also, a masterclass in experimental design.

Jonathan Nicholas@jonathannicholas.bsky.social

Our experiences have countless details, and it can be hard to know which matter. How can we behave effectively in the future when, right now, we don't know what we'll need? Out today in @nathumbehav.nature.com , @marcelomattar.bsky.social and I find that people solve this by using episodic memory.

Fred Callaway reposted

Writing is thinking Outsourcing the entire task of writing to LLMs will deprive us of the essential creative task of interpreting our findings and generating a deeper theoretical understanding of the world.

Fred Callaway reposted

We're excited to announce that Cognitive Science at Dartmouth is recruiting PhD students to work collaboratively with me, Steven Frankland, and Fred Callaway. Come study the principles and mechanisms that enable us to understand, plan, and act in the world! Info: sites.dartmouth.edu/cogscigrad/

sites.dartmouth.eduCognitive Science Graduate Admissions – Information about graduate admissions from the cognitive science faculty

Fred Callaway reposted

1st Sharp Lab preprint! 🚨 We tested how anxiety affects task generalization—not how people generalize threat stimuli, but how they reuse action-outcome structures when planning in new contexts. Worry makes people avoid reusing actions that co-occurred w/ threat! 📄: osf.io/preprints/ps... 🧵 1/12

Fred Callaway reposted

Forget modeling every belief and goal! What if we represented people as following simple scripts instead (i.e "cross the crosswalk")? Our new paper shows AI which models others’ minds as Python code 💻 can quickly and accurately predict human behavior! shorturl.at/siUYI%F0%9F%...

Fred Callaway reposted

We often hear from reviewers: "what about demand effects?" So we developed a method to eliminate them. Something weird happened during testing: We couldn’t detect demand effects in the first place! (1/8)

Fred Callaway reposted

Fred Callaway reposted

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...