Alona Fyshe

Alona Fyshe

@alonaf.bsky.social

Associate prof @ UAlberta (CS and Psychology) studying language and semantic representations in the brain. TED speaker

1.4K followers77 following24 posts

Alona Fyshe reposted

Over 400 academics in 30+ countries signed our open letter calling for immediate changes in AI development and deployment practices to ensure that cybersecurity incidents do not continue to occur, as future incidents will be far more damaging to our critical infrastructure.

I am once again asking you to consider sending your amazing papers to the "Studying Language Processing in the Era of LLMs" Special Issue!

Alona Fyshe@alonaf.bsky.social

Submit an article to our SI "Studying Language Processing in the Era of LLMs" We're interested in papers using cognitive priors to improve LLM, using LLMs to understand the brain’s processing of language, or using theories/methods/tests inspired by cognitive science to understand LLMs, and more!

Submit an article to our SI "Studying Language Processing in the Era of LLMs" We're interested in papers using cognitive priors to improve LLM, using LLMs to understand the brain’s processing of language, or using theories/methods/tests inspired by cognitive science to understand LLMs, and more!

sciencedirect.comBrain and Language | ScienceDirect.com by Elsevier - Brain and Language | ScienceDirect.com by ElsevierRead the latest articles of Brain and Language at ScienceDirect.com, Elsevier’s leading platform of peer-reviewed scholarly literature

Alona Fyshe reposted

Alona Fyshe @alonaf.bsky.social on the BabyLM Challenge, a competition that trains language models (LMs) on smaller datasets, more akin to how a baby learns, in search of solutions to some of the major challenges of today’s LLMs. #NeuroAI #neuroskyence www.thetransmitter.org/neuroai/the-...

thetransmitter.orgCan babies inspire more efficient learning algorithms?A competition that trains language models on smaller datasets, more akin to how a baby learns, seeks solutions to some of LLM’s major challenges.

Alona Fyshe reposted

Every year at the end of the semester, I ask the students in my Psych of Language class to create memes about what they've learned. They then vote for their favorites. Here's the winner about how the idea of a universal grammar is no longer as compelling as it once seemed. 1/5

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

Our method also identified several body-related clusters (EBA in the figure). The positive representative images for one cluster showed people and animals outside with an emphasis on legs and active movement. The negative images typically depict people sitting with their legs obscured by tables.

Another cluster emphasized hands instead of legs. Positive images show people with their hands clearly visible, while the negative images are exclusively non-primate animals without hands. Thus, the brain's “body” area may be made up of multiple more refined concepts (i.e. legs and hands).

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

Our method identified a large possibly food-related cluster with many positive food-related images, and the area aligned with a recently previously food area (i.e. the colored brain areas in the figure overlap with the reported food area).

However, we also observed many vibrant and colorful positive images that contained no food. Strikingly, the negative representative images are entirely gray-scale! This provided very strong evidence that this brain area may be responding to color, not food.

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

These clusters allowed us to identify stimulus images that most drive neural activity in the voxels of a cluster (positive images), but also the images which are most associated with below-average voxel response (negative images).

The positive and negative images provide additional evidence for the possible function of brain areas, helping us to refine hypotheses about the associated brain areas.

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

We first trained a model to map fMRI to CLIP representations. We then clustered the *parameters* of that model to identify voxels that are driven by certain CLIP concepts. Because we cluster in model parameter space, we can look for concept representations across participants.

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

View full thread

There have been multiple attempts to identify new functionally localized regions of the brain with some converging evidence; for example, a possible “food area” was recently reported.

Still, only a few broad semantic categories have been identified, and they typically cover large areas of the brain. So… there may be other semantic categories localized in the brain (or a way to refine existing categories)!

Our ICLR poster is Saturday Morning (Hall 3 + Hall 2B #63)! We (myself with Cory Efird, Alex Murphy and Joel Zylberberg) are excited to share our work searching for Shared Decodable Concepts in the human brain. We used the Natural Scenes Dataset to find the concepts that most drive brain activity…

Neuroimaging has revealed a lot about how the brain processes and organizes visual information. For example, there is evidence that certain areas of the brain activate in response to images depicting specific semantic concepts like faces, places, bodies, and words.

You are up to date.