Jesseba Fernando

Jesseba Fernando

@jesseba.bsky.social

PhD Student @nunetsi.bsky.social Put me in the middle of nowhere with coffee and I'm happy jesseba.github.io

88 followers409 following21 posts

Jesseba Fernando reposted

I wrote an essay for @noemamag.com about AI consciousness, animal research, and the limits of what we can know about another mind. My argument: the lessons neuroscientists learned hunting for neural markers of consciousness in animals are exactly the ones we'll need as we start asking...

Noema Magazine@noemamag.com

“The science of consciousness & the ethics of moral consideration — what we have learned from rats & monkeys & humans — will have to guide us as we meet artificial minds,” @guitchounts.bsky.social writes. #ai #aiethics #consciousness

Jesseba Fernando reposted

"'They’re spending more money than I would even tax them,' [Mamdani] said in an interview with MSNBC last week." This is the message. Make it clear that these billionaires aren't just worried about losing money. They're worried about losing the ability to exchange their money for power.

Jesseba Fernando reposted

G Elliott Morris@gelliottmorris.com

Good evening. We estimate that between 4.2 and 7.6 million people turned out for the No Kings Day demonstrations held around the country on Saturday. This makes Oct 18 very likely the biggest single-day U.S. protest event since 1970. www.gelliottmorris.com/p/second-no-...

Already counting down till next year ⏳

Giulio Pergola@giuliopergola.bsky.social

Great time at @css-conference.bsky.social in Siena 🇮🇹! Spoke on #schizophrenia risk genes in dynamic co-expression networks across brain development. Thanks to @nicopedre.bsky.social, @marilyngatica.bsky.social and @jesseba.bsky.social for the #CoBrain satellite on complex systems in neuroscience👏

Packed room at our satellite!!

NPlab@nplab.bsky.social

Cobrain starting in room 18 @css-conference.bsky.social Program here: kgatica.github.io/CCS2025-CoBr... @jesseba.bsky.social @nicopedre.bsky.social @marilyngatica.bsky.social

Jesseba Fernando reposted

- did not measure people's creativity performance by any reputable creativity task or measure, just measured the ESSAY content (after giving people different instructions) - did not measure people's overall MEMORY ABILITY - false on "brain activity," DIFFERENT activity is not "weaker"

This post is unavailable.

Jesseba Fernando reposted

Hot takes/kind reminders a) “the bitter lesson”’s promise of scale did not deliver wrt AI reasoning & higher cog functions—O3 hallucinates 2x more than O1 b) prediction is not understanding, hallucinating is worse c) gen AI could help neuroAI but following latest AI trends is not a paradigm shift

The Transmitter @thetransmitter.bsky.social

How can we make progress in developing a general model of neural computation rather than a series of disjointed models tied to specific experimental circumstances, ask Eva Dyer and @tyrellturing.bsky.social in the latest entry in our NeuroAI series. www.thetransmitter.org/neuroai/acce...

Jesseba Fernando reposted

I guess it’s homegrown crim of me to publicize my thoughts on Columbia rolling over so easily

Marisa Kabas@marisakabas.bsky.social

Holy shit. Video posted by President Bukele’s team on X shows the moments before his press conference with Trump in which Trump tells him: “We want to do homegrown criminals next. You gotta build about five more places.” (h/t @titonka.bsky.social @michelekelemen.bsky.social)

Jesseba Fernando reposted

Coinciding with it's "No" letter Harvard has refashioned its university homepage into essentially an advertisement for the social benefits of university research. This is the current front page.

Jesseba Fernando reposted

Replying to @nikobowie.bsky.social

We are rallying at noon at Cambridge Common for the leadership of the Harvard Corporation to stand up and stand with us as we defend higher education and democracy in the United States from an unprecedented attack.

Jesseba Fernando reposted

Replying to @nikobowie.bsky.social

Over 800 faculty have urged Harvard's leadership to "legally contest ... unlawful demands that threaten academic freedom and university self-governance." The Cambridge City Council has called on it to "stand up in defense of the values that are fundamental to both the University and our democracy."

thecrimson.comCambridge City Council Calls on Harvard, President Garber to Resist Trump’s Threats | News | The Harvard CrimsonThe Cambridge City Council voted unanimously on Monday to call on the Harvard Corporation — the University’s highest governing body — to refuse the Trump administration’s demands as $9 billion in gove...

Jesseba Fernando reposted

Replying to @lakauffman.bsky.social

For the data nerds out there, here's a chart of the largest coordinated protests in U.S. history from my 2018 book HOW TO READ A PROTEST Today's "Hands Off" protests, in 1000+ locations around the country, rank as one of the very largest decentralized days of protests EVER.

Jesseba Fernando reposted

If you’re upset about the chaos and corruption Trump is inflicting on your country—whether your focus is the nihilistic dismantling of government, the economy, our foreign relations, or his threats to the rule of law—please join the nationwide marches on April 5. Learn more here 👉 handsoff2025.com

handsoff2025.comHands Off!Donald Trump and Elon Musk think this country belongs to them. They're taking everything they can get their hands on and daring the world to stop them. On Saturday, April 5th, we're taking to the stre...

Jesseba Fernando reposted

If you are a faculty member at a US university, please consider signing this excellent petition asking our presidents, chancellors, etc to work together to defend our institutions from the direct attacks by Trump administration: sites.google.com/view/we-must...

sites.google.comHomeMarch 20, 2025 Dear Presidents, Chancellors, and Boards of Trustees of the 60 Universities that received a March 10th warning letter from the U.S. Department of Education: You are on the frontlines ...

Jesseba Fernando reposted

I think some in the Senate have convinced themselves that the backlash to folding will be limited to “the left” and therefore ignorable. Those people are deeply and profoundly misreading the moment and the stakes. Virtually every swing district House Dem walked the plank to vote NO for a reason.

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

View full thread

11/ Finally, we asked: Does the RS behave like a dynamical system? To test this, we teleported RS vectors to different positions in PCA space and observed their evolution. Result? Early layers exhibit attractor-like behavior—pushing activations back toward their “natural” trajectory.

12/ Neuroscientists have been doing MechInterp on the brain for many decades now, and while access to the underlying system has been shallow for the brain vs. NNs, the theory is advanced and (we argue) could still be useful for understanding AI. The paper: arxiv.org/abs/2502.12131 (End of thread)

arxiv.orgTransformer Dynamics: A neuroscientific approach to interpretability of large language modelsAs artificial intelligence models have exploded in scale and capability, understanding of their internal mechanisms remains a critical challenge. Inspired by the success of dynamical systems approache...

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

View full thread

9/ Looking at individual unit dynamics, we found rotational trajectories in activation space! Some units spin around a fixed point, others spiral outward. On average, RS units circle ~10 times over 64 layers.

10/ To visualize global RS behavior, we trained a Compressing Autoencoder (CAE)—squashing activations into 2D. The CAE finds low-dimensional population dynamics, which showed that early layers are harder to reconstruct, while later layers become lower-dimensional and more structured.

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

View full thread

7/ Zooming out: the cosine similarity of the RS vector between layers increases. Translation: The model’s internal representations become more aligned as we move deeper through the model. But they also accelerate!

8/ And here’s something even weirder: mutual information drops in early layers, then slowly climbs back up. Why? We’re not sure—perhaps early layers are quite predictable from one to the next, but in a nonlinear way...

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

View full thread

5/ First surprise: RS activations increase in density over layers. Early layers are sparse, later layers are dense. Why? There’s no a priori reason for this—blocks could just as easily write balancing negative values. But they don’t.

6/ Second surprise: RS activations are highly correlated layer to layer. A given unit’s activation is highly correlated across layers—especially within a layer (attention to MLP) vs. across layers.

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

View full thread

3/ Instead of looking at individual activations as snapshots in time, we took inspiration from neuroscience and studied population dynamics. Key idea: Computation in the brain isn't static—it unfolds over time in a distributed way. Do activations actually evolve in transformers? 🤔

4/. Unlike the brain, transformers don’t have real time. But they do have layers. The residual stream (RS) is updated twice per layer—once by attention, once by MLPs. For a 32-layer model, that’s 64 pseudo-time steps per token. So… what happens inside?

1/ How do AI models actually work? 🤷‍♂️ AI models are complex, nonlinear systems, and their inner workings remain largely mysterious. Enter Mechanistic Interpretability. But MechInterp has struggled to explain a lot of the observed phenomena…

Jesseba Fernando reposted

A small sample of populations served by NIH proposals that I personally know are stalled in review right now: kids with concussions, people with Alzheimer’s, caregivers of people with disabilities, adults ages 60+ Just keeping a record of who’s on the losing end of executive orders.

Jesseba Fernando reposted

NEW: 2024 has just been confirmed as the warmest year on record, and the first to breach the 1.5C threshold. We used a ridgeline (Joy Division inspired) chart to visualise daily temperature anomalies since 1940. 2024 clearly stands out with 100% of its days above 1.3C and 75% above 1.5C.

You are up to date.