Alexander van Meegen

Alexander van Meegen

@avm.bsky.social

Theory of Neural Networks (how the heck do they work?) Assistant Professor @RWTH Previous: Postdoc @EPFL, Swartz Fellow @Harvard Lab: https://avmlab.physik.rwth-aachen.de Personal: alexvanmeegen.github.io Background art: https://www.bettina-hachmann.de

369 followers483 following15 posts

Alexander van Meegen reposted

1/ Why does predicting in latent space (JEPA, CPC, SimCLR...) work so well on messy data, with changing lighting, camera angles, and busy backgrounds? The usual answer: it can ignore nuisance. But that answer holds a conundrum.

Alexander van Meegen reposted

How can RNNs re-use the same dynamics across different tasks to implement compositional computation? What are the consequences for network connectivity & activity? If you're interested, come and find out at the Bernstein Conference, poster session III-#48!

Alexander van Meegen reposted

Both brains and RNNs can re-use components of computation across similar tasks or contexts. But what exactly are those “shared components”? How can they be used to solve several tasks? We address these questions in a new preprint with @avm.bsky.social! Link: www.biorxiv.org/content/10.6...

biorxiv.orgInterpretable compositional computation with recurrent neural networksFlexible cognition utilizes reusable components to enable rapid adaptation of behavior to different contexts or tasks. Analysis of artificial neural networks trained on multiple tasks suggested that t...

Interested in multitasking RNNs from a theory perspective? Check out this preprint with the amazing @lpezon.bsky.social. TLDR: A low-rank / latent space approach to @lndriscoll.bsky.social & @sussillodavid.bsky.social style shared components. And a story starring solution space degeneracy.

Louis Pezon@lpezon.bsky.social

Both brains and RNNs can re-use components of computation across similar tasks or contexts. But what exactly are those “shared components”? How can they be used to solve several tasks? We address these questions in a new preprint with @avm.bsky.social! Link: www.biorxiv.org/content/10.6...

Alexander van Meegen reposted

Tremendously excited to announce that I will be joining @rockefeller.edu as an Assistant Professor and Head of Lab starting in January 2027! My group will be broadly focused on theoretical neuroscience, and mathematical problems in neural computation in the large.

Alexander van Meegen reposted

NEW PAPER. Why do larger networks train better? "Because they contain more candidate *sub*networks that can learn the task" → lottery tickets This popular explanation uses an appealing but misleading metaphor🧵 We propose an intuitive alternative grounded in theory: escape dimensions

Alexander van Meegen reposted

Alexander van Meegen reposted

1/7 New paper accepted as ICML spotlight arxiv.org/abs/2605.03517! We unify self-supervised learning (SSL) algorithms (e.g., contrastive, VICReg, stopgrad) via latent distribution matching (LDM), which matches an induced latent distribution to an explicit latent model.

Alexander van Meegen reposted

New preprint: "Linear equivalence of nonlinear recurrent neural networks." For large nonlinear (potentially chaotic) RNNs with random connectivity, the full N×N covariance matrix takes the same form as that of a ~linear~ network with the same couplings, driven by independent noise.

arxiv.orgLinear equivalence of nonlinear recurrent neural networksLarge nonlinear recurrent neural networks with random couplings generate high-dimensional, potentially chaotic activity whose structure is of interest in neuroscience, machine learning, ecology, and o...

Alexander van Meegen reposted

I am looking for a theory/computational POSTDOC position in EU or east coast US. I am interested in how learning and plasticity shape population dynamics & representational geometries & how these changes are reflected in behavior. If you are at #COSYNE2026 & interested, hit me up in Whova, not here

Alexander van Meegen reposted

Belated update: I joined UIUC ECE as an Assistant Professor. Our lab works at the intersection of theoretical neuroscience, machine learning, and dynamical systems, with a focus on learning and spiking networks. I had to miss #COSYNE2026 for visa reasons. 1/2

Alexander van Meegen reposted

Presenting a poster tomorrow at Cosyne 26: [3-033] Compositional computation via shared latent dynamics in low-rank RNNs. With @avm.bsky.social, we explore how RNNs can re-use the same dynamics across different tasks, and what it implies for their connectivity and neural activity.

Travelling to COSYNE seems to be the perfect opportunity to announce that I started my own lab at RWTH Aachen University earlier this year, funded by NRW's Ministry of Culture and Science through its Return Program. If you are at COSYNE and want to chat please reach out!

Alexander van Meegen reposted

Alexander van Meegen reposted

Alexander van Meegen reposted

Our paper on data constrained RNN that generalize to optogenetic perturbations now citable on eLife: doi.org/10.7554/eLif...

doi.orgBiologically informed cortical models predict optogenetic perturbations
Guillaume Bellec@bellecguill.bsky.social

Pre-print 🧠🧪 Is mechanism modeling dead in the AI era? ML models trained to predict neural activity fail to generalize to unseen opto perturbations. But mechanism modeling can solve that. We say "perturbation testing" is the right way to evaluate mechanisms in data-constrained models 1/8

Alexander van Meegen reposted

1/X Excited to present this preprint on multi-tasking, with @david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as “low-D manifold” has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...

biorxiv.orgA theory of multi-task computation and task selectionNeural activity during the performance of a stereotyped behavioral task is often described as low-dimensional, occupying only a limited region in the space of all firing-rate patterns. This region has...

Alexander van Meegen reposted

🧵Excited to present our latest work at #Neurips25! Together with @avm.bsky.social, we discover 𝐜𝐡𝐚𝐧𝐧𝐞𝐥𝐬 𝐭𝐨 𝐢𝐧𝐟𝐢𝐧𝐢𝐭𝐲: regions in neural networks loss landscapes where parameters diverge to infinity (in regression settings!) We find that MLPs in these channels can take derivatives and compute GLUs 🤯

Alexander van Meegen reposted

Finally got the job ad—looking for 2 PhD students to start spring next year: www.gao-unit.com/join-us/ If comp neuro, ML, and AI4Neuro is your thing, or you just nerd out over brain recordings, apply! I'm at neurips. DM me here / on the conference app or email if you want to meet 🏖️🌮

Alexander van Meegen reposted

paper🚨 When we learn a category, do we learn the structure of the world, or just where to draw the line? In a cross-species study, we show that humans, rats & mice adapt optimally to changing sensory statistics, yet rely on fundamentally different learning algorithms. www.biorxiv.org/content/10.1...

biorxiv.orgDifferent learning algorithms achieve shared optimal outcomes in humans, rats, and miceAnimals must exploit environmental regularities to make adaptive decisions, yet the learning algorithms that enabels this flexibility remain unclear. A central question across neuroscience, cognitive science, and machine learning, is whether learning relies on generative or discriminative strategies. Generative learners build internal models the sensory world itself, capturing its statistical structure; discriminative learners map stimuli directly onto choices, ignoring input statistics. These strategies rely on fundamentally different internal representations and entail distinct computational trade-offs: generative learning supports flexible generalisation and transfer, whereas discriminative learning is efficient but task-specific. We compared humans, rats, and mice performing the same auditory categorisation task, where category boundaries and rewards were fixed but sensory statistics varied. All species adapted their behaviour near-optimally, consistent with a normative observer constrained by sensory and decision noise. Yet their underlying algorithms diverged: humans predominantly relied on generative representations, mice on discriminative boundary-tracking, and rats spanned both regimes. Crucially, end-point performance concealed these differences, only learning trajectories and trial-to-trial updates revealed the divergence. These results show that similar near-optimal behaviour can mask fundamentally different internal representations, establishing a comparative framework for uncovering the hidden strategies that support statistical learning. ### Competing Interest Statement The authors have declared no competing interest. Wellcome Trust, https://ror.org/029chgv08, 219880/Z/19/Z, 225438/Z/22/Z, 219627/Z/19/Z Gatsby Charitable Foundation, GAT3755 UK Research and Innovation, https://ror.org/001aqnf71, EP/Z000599/1

Alexander van Meegen reposted

This was a lot of fun! From my side, it started with a technical Q: what's the relation between two-side cavity and path integrals? Turns out it's a fluctuation correction - and amazingly, this also enable the "O(N) rank" theory by @david-g-clark.bsky.social and @omarschall.bsky.social. 🤯

David G. Clark@david-g-clark.bsky.social

Now in PRX: Theory linking connectivity structure to collective activity in nonlinear RNNs! For neuro fans: conn. structure can be invisible in single neurons but shape pop. activity For low-rank RNN fans: a theory of rank=O(N) For physics fans: fluctuations around DMFT saddle⇒dimension of activity

Alexander van Meegen reposted

First paper from the lab! We propose a model that separates estimation of odor concentration and presence and map it on olfactory bulb circuits Led by @chenjiang01.bsky.social and @mattyizhenghe.bsky.social joint work with @jzv.bsky.social and with @neurovenki.bsky.social @cpehlevan.bsky.social

bioRxiv Neuroscience@biorxiv-neursci.bsky.social

Simultaneous detection and estimation in olfactory sensing https://www.biorxiv.org/content/10.1101/2025.11.01.686013v1

Alexander van Meegen reposted

Check out our new preprint where we analyzed the dynamics of over ten thousand neurons across 223 brain areas and found a surprising universal principle that describes the organization of intrinsic timescales across the entire mouse brain, including subcortical structures! #neuroskyence

Yanliang Shi@shiyanliang.bsky.social

Excited to share our new preprint on the brain-wide organization of intrinsic timescales at single neuron resolution. Work w/ @roxana-zeraati.bsky.social, @intlbrainlab.bsky.social, Anna Levina, @engeltatiana.bsky.social : www.biorxiv.org/content/10.1...

Alexander van Meegen reposted

Alexander van Meegen reposted

Excited to share new computational work, led by @jzv.bsky.social, driven by Juan Carlos Fernandez del Castillo + contribution from Farhad Pashakanloo. We recover 3 core motifs in the olfactory system of evolutionarily distant animals using a biophysically-grounded model + efficient coding ideas!

biorxiv.orgConvergent motifs of early olfactory processing are recapitulated by layer-wise efficient codingThe architecture of early olfactory processing is a striking example of convergent evolution. Typically, a panel of broadly tuned receptors is selectively expressed in sensory neurons (each neuron exp...

Alexander van Meegen reposted

Alexander van Meegen reposted

I wrote a Comment on neurotheory, and now you can read it! Some thoughts on where neurotheory has and has not taken root within the neuroscience community, how it has shaped those subfields, and where we theorists might look next for fresh adventures. www.nature.com/articles/s41...

nature.comTheoretical neuroscience has room to growNature Reviews Neuroscience - The goal of theoretical neuroscience is to uncover principles of neural computation through careful design and interpretation of mathematical models. Here, I examine...

Alexander van Meegen reposted

Wanted to share a new version (much cleaner!) of a preprint on how connectivity structure shapes collective dynamics in nonlinear RNNs. Neural circuits have highly non-iid connectivity (e.g., rapidly decaying singular values, structured singular-vector overlaps), unlike classical random RNN models.

arxiv.orgConnectivity structure and dynamics of nonlinear recurrent neural networksStudies of the dynamics of nonlinear recurrent neural networks often assume independent and identically distributed couplings, but large-scale connectomics data indicate that biological neural circuit...

Alexander van Meegen reposted

Alexander van Meegen reposted

Coming March 17, 2026! Just got my advance copy of Emergence — a memoir about growing up in group homes and somehow ending up in neuroscience and AI. It’s personal, it’s scientific, and it’s been a wild thing to write. Grateful and excited to share it soon.

Alexander van Meegen reposted

Physik studieren? Oder ein anderes Fach? In Göttingen geht jetzt beides, mit dem "Bachelor Interdisziplinär", der Physik mit spannenden Disziplinen Eurer Wahl, wie z.B. Künstlicher Intelligenz, Philosophie, Neurowissenschaften, ... kombiniert. www.uni-goettingen.de/de/studium/6...

uni-goettingen.deStudiengang Physik interdisziplinär - Georg-August-Universität GöttingenWebseiten der Georg-August-Universität Göttingen

Alexander van Meegen reposted

(1/23) In addition to the new Lady Gaga album "Mayhem," my paper with Manuel Beiran, "Structure of activity in multiregion recurrent neural networks," has been published today. PNAS link: www.pnas.org/doi/10.1073/... (see dclark.io for PDF) An explainer thread...

pnas.orgStructure of activity in multiregion recurrent neural networks | PNASNeural circuits comprise multiple interconnected regions, each with complex dynamics. The interplay between local and global activity is thought to...

Interested in high-dim chaotic networks? Ever wondered about the structure of their state space? @jakobstubenrauch.bsky.social has answers - from a separation of fixed points and dynamics onto distinct shells to a shared lower-dim manifold and linear prediction of dynamics.

Jakob Stubenrauch@jakobstubenrauch.bsky.social

(1/3) How to analyse a dynamical system? Find its fixed points, study their properties! How to analyse a *high-dimensional* dynamical system? Find its fixed points, study their properties! We do that for a chaotic neural network! finally published: doi.org/10.1103/Phys...

Alexander van Meegen reposted

Our new preprint 👀

Matteo Carandini@carandinilab.net

The firing of neural populations is high-dim even if their subthreshold activity is low-dim! This work by @bio-emergent.bsky.social and @haydari.bsky.social shows how, with a solvable model, a data analysis technique, and data from mouse visual cortex: www.biorxiv.org/content/10.1...

Alexander van Meegen reposted

I'll be presenting this at #cosyne2025 (poster 3-50)! I'll also be giving a talk at the "Collectively Emerged Timescales" workshop on this work, plus other projects on emergent dynamics in neural circuits. Looking forward to seeing everyone in 🇨🇦!

Alexander van Meegen reposted

We always see that 1) neural responses are very diverse 2) the shattering dimensionality is as high as it can be. Now also in an extensive analysis of the IBL dataset. Wonderful collaboration with @lorenzoposani.com, Shuqi Wang, Samuel Muscinelli, Liam Paninski. Many new analyses in this new version

Alexander van Meegen reposted