Theory of Neural Networks (how the heck do they work?)
Assistant Professor @RWTH
Previous: Postdoc @EPFL, Swartz Fellow @Harvard
Lab: https://avmlab.physik.rwth-aachen.de
Personal: alexvanmeegen.github.io
Background art: https://www.bettina-hachmann.de
Happy to announce our project on intracranial ephys artifacts is finally out 🙈
doi.org/10.1523/JNEUROSCI.0295-26.2026
It all began with an observation, are neurons across an entire array synchronizing at 1/30 ms resolution in cortex? Identical waveforms? Revolutionary if true, but...
Blueprint!🧵
1/ Why does predicting in latent space (JEPA, CPC, SimCLR...) work so well on messy data, with changing lighting, camera angles, and busy backgrounds? The usual answer: it can ignore nuisance. But that answer holds a conundrum.
📣 Multiple Flatiron Research Fellow (FRF) postdoc positions are available in my @flatironinstitute.org group!
We've never been better positioned to understand how high-dimensional nonlinear dynamical systems (neural circuits!) compute. If this is as exciting to you as it is to me, consider applying:
How can RNNs re-use the same dynamics across different tasks to implement compositional computation?
What are the consequences for network connectivity & activity?
If you're interested, come and find out at the Bernstein Conference, poster session III-#48!
Both brains and RNNs can re-use components of computation across similar tasks or contexts.
But what exactly are those “shared components”? How can they be used to solve several tasks?
We address these questions in a new preprint with @avm.bsky.social!
Link:
www.biorxiv.org/content/10.6...
Interested in multitasking RNNs from a theory perspective? Check out this preprint with the amazing @lpezon.bsky.social.
TLDR: A low-rank / latent space approach to @lndriscoll.bsky.social & @sussillodavid.bsky.social style shared components. And a story starring solution space degeneracy.
Both brains and RNNs can re-use components of computation across similar tasks or contexts.
But what exactly are those “shared components”? How can they be used to solve several tasks?
We address these questions in a new preprint with @avm.bsky.social!
Link:
www.biorxiv.org/content/10.6...
Tremendously excited to announce that I will be joining @rockefeller.edu as an Assistant Professor and Head of Lab starting in January 2027! My group will be broadly focused on theoretical neuroscience, and mathematical problems in neural computation in the large.
NEW PAPER. Why do larger networks train better?
"Because they contain more candidate *sub*networks that can learn the task" → lottery tickets
This popular explanation uses an appealing but misleading metaphor🧵
We propose an intuitive alternative grounded in theory: escape dimensions
Every summer I repost this article on how to spot drowning. Please read it and pass on. In the last few years I’ve had SIX messages from people who saved a kid’s life after clicking on the link from my feed.
slate.com/technology/2...
1/7 New paper accepted as ICML spotlight arxiv.org/abs/2605.03517! We unify self-supervised learning (SSL) algorithms (e.g., contrastive, VICReg, stopgrad) via latent distribution matching (LDM), which matches an induced latent distribution to an explicit latent model.
New preprint: "Linear equivalence of nonlinear recurrent neural networks." For large nonlinear (potentially chaotic) RNNs with random connectivity, the full N×N covariance matrix takes the same form as that of a ~linear~ network with the same couplings, driven by independent noise.
I am looking for a theory/computational POSTDOC position in EU or east coast US. I am interested in how learning and plasticity shape population dynamics & representational geometries & how these changes are reflected in behavior.
If you are at #COSYNE2026 & interested, hit me up in Whova, not here
Belated update: I joined UIUC ECE as an Assistant Professor. Our lab works at the intersection of theoretical neuroscience, machine learning, and dynamical systems, with a focus on learning and spiking networks. I had to miss #COSYNE2026 for visa reasons. 1/2
Presenting a poster tomorrow at Cosyne 26:
[3-033] Compositional computation via shared latent dynamics in low-rank RNNs.
With @avm.bsky.social, we explore how RNNs can re-use the same dynamics across different tasks, and what it implies for their connectivity and neural activity.
Travelling to COSYNE seems to be the perfect opportunity to announce that I started my own lab at RWTH Aachen University earlier this year, funded by NRW's Ministry of Culture and Science through its Return Program. If you are at COSYNE and want to chat please reach out!
If you're at #cosyne2026 in Lisbon, come check out Juan Carlos Fernández del Castillo's poster 1-007 tonight, based on our paper on efficient coding in olfaction (www.biorxiv.org/content/10.1...)!
Excited to be giving the van Vreeswijk Theoretical Neuroscience Seminar this Wednesday, Jan 14, where I'll talk about "Computation Through Neuronal-Synaptic Dynamics"!
www.wwtns.online
Pre-print 🧠🧪
Is mechanism modeling dead in the AI era?
ML models trained to predict neural activity fail to generalize to unseen opto perturbations. But mechanism modeling can solve that.
We say "perturbation testing" is the right way to evaluate mechanisms in data-constrained models
1/8
1/X Excited to present this preprint on multi-tasking, with
@david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as “low-D manifold” has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...
🧵Excited to present our latest work at #Neurips25! Together with @avm.bsky.social, we discover 𝐜𝐡𝐚𝐧𝐧𝐞𝐥𝐬 𝐭𝐨 𝐢𝐧𝐟𝐢𝐧𝐢𝐭𝐲: regions in neural networks loss landscapes where parameters diverge to infinity (in regression settings!)
We find that MLPs in these channels can take derivatives and compute GLUs 🤯
Finally got the job ad—looking for 2 PhD students to start spring next year:
www.gao-unit.com/join-us/
If comp neuro, ML, and AI4Neuro is your thing, or you just nerd out over brain recordings, apply!
I'm at neurips. DM me here / on the conference app or email if you want to meet 🏖️🌮
paper🚨
When we learn a category, do we learn the structure of the world, or just where to draw the line? In a cross-species study, we show that humans, rats & mice adapt optimally to changing sensory statistics, yet rely on fundamentally different learning algorithms.
www.biorxiv.org/content/10.1...
Connectome datasets alone are generally not sufficient to predict neural activity. However, pairing connectivity information with neural recordings can produce accurate predictions of activity in unrecorded neurons
www.nature.com/articles/s41...
This was a lot of fun! From my side, it started with a technical Q: what's the relation between two-side cavity and path integrals? Turns out it's a fluctuation correction - and amazingly, this also enable the "O(N) rank" theory by @david-g-clark.bsky.social and @omarschall.bsky.social. 🤯
Now in PRX: Theory linking connectivity structure to collective activity in nonlinear RNNs!
For neuro fans: conn. structure can be invisible in single neurons but shape pop. activity
For low-rank RNN fans: a theory of rank=O(N)
For physics fans: fluctuations around DMFT saddle⇒dimension of activity
A study led by Cina Aghamohammadi is now out in @natcomms.nature.com! We developed a mathematical framework for partitioning spiking variability, which revealed that spiking irregularity is nearly invariant for each neuron and decreases along the cortical hierarchy.
www.nature.com/articles/s41...
🎉 "High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable model" will be presented as an oral at #NeurIPS2025 🎉
Feeling very grateful that reviewers and chairs appreciated concise mathematical explanations, in this age of big models.
www.biorxiv.org/content/10.1...
1/2
Lab members are at the Bernstein conference @bernsteinneuro.bsky.social with 9 posters! Here’s the list:
TUESDAY 16:30 – 18:00
P1 62 “Measuring and controlling solution degeneracy across task-trained recurrent neural networks” by @flavioh.bsky.social
Check out our new preprint where we analyzed the dynamics of over ten thousand neurons across 223 brain areas and found a surprising universal principle that describes the organization of intrinsic timescales across the entire mouse brain, including subcortical structures!
#neuroskyence
Excited to share our new preprint on the brain-wide organization of intrinsic timescales at single neuron resolution. Work w/ @roxana-zeraati.bsky.social, @intlbrainlab.bsky.social, Anna Levina, @engeltatiana.bsky.social : www.biorxiv.org/content/10.1...
Since I'm back on BlueSky - with @frostedblakess.bsky.social and @cpehlevan.bsky.social we wrote a brief perspective on how ideas about summary statistics from the statistical physics of learning could potentially help inform neural data analysis... (1/2)
Excited to share new computational work, led by @jzv.bsky.social, driven by Juan Carlos Fernandez del Castillo + contribution from Farhad Pashakanloo. We recover 3 core motifs in the olfactory system of evolutionarily distant animals using a biophysically-grounded model + efficient coding ideas!
(1/26) Excited to share a new preprint led by grad student Albert Wakhloo, with me and Larry Abbott: "Associative synaptic plasticity creates dynamic persistent activity."
www.biorxiv.org/content/10.1...
I wrote a Comment on neurotheory, and now you can read it!
Some thoughts on where neurotheory has and has not taken root within the neuroscience community, how it has shaped those subfields, and where we theorists might look next for fresh adventures.
www.nature.com/articles/s41...
Wanted to share a new version (much cleaner!) of a preprint on how connectivity structure shapes collective dynamics in nonlinear RNNs. Neural circuits have highly non-iid connectivity (e.g., rapidly decaying singular values, structured singular-vector overlaps), unlike classical random RNN models.
Excited to announce that my first postdoc paper is now online!
Links:
www.nature.com/articles/s41...rdcu.be/eAcN7
In it, we examine the perennial question: what changes in the brain when learning a new motor skill?
Read more below to find out 👇
Coming March 17, 2026!
Just got my advance copy of Emergence — a memoir about growing up in group homes and somehow ending up in neuroscience and AI. It’s personal, it’s scientific, and it’s been a wild thing to write. Grateful and excited to share it soon.
Physik studieren? Oder ein anderes Fach?
In Göttingen geht jetzt beides, mit dem "Bachelor Interdisziplinär", der Physik mit spannenden Disziplinen Eurer Wahl, wie z.B. Künstlicher Intelligenz, Philosophie, Neurowissenschaften, ... kombiniert.
www.uni-goettingen.de/de/studium/6...
Out today in @nature.com: we show that individual neurons have diverse tuning to a decision variable computed by the entire population, revealing a unifying geometric principle for the encoding of sensory and dynamic cognitive variables.
www.nature.com/articles/s41...
(1/23) In addition to the new Lady Gaga album "Mayhem," my paper with Manuel Beiran, "Structure of activity in multiregion recurrent neural networks," has been published today.
PNAS link: www.pnas.org/doi/10.1073/...
(see dclark.io for PDF)
An explainer thread...
Interested in high-dim chaotic networks? Ever wondered about the structure of their state space? @jakobstubenrauch.bsky.social has answers - from a separation of fixed points and dynamics onto distinct shells to a shared lower-dim manifold and linear prediction of dynamics.
(1/3) How to analyse a dynamical system? Find its fixed points, study their properties!
How to analyse a *high-dimensional* dynamical system? Find its fixed points, study their properties!
We do that for a chaotic neural network! finally published: doi.org/10.1103/Phys...
The firing of neural populations is high-dim even if their subthreshold activity is low-dim! This work by @bio-emergent.bsky.social and @haydari.bsky.social shows how, with a solvable model, a data analysis technique, and data from mouse visual cortex: www.biorxiv.org/content/10.1...
I'll be presenting this at #cosyne2025 (poster 3-50)!
I'll also be giving a talk at the "Collectively Emerged Timescales" workshop on this work, plus other projects on emergent dynamics in neural circuits.
Looking forward to seeing everyone in 🇨🇦!
(1/30) New preprint! "Symmetries and continuous attractors in disordered neural circuits" with Larry Abbott and Haim Sompolinsky
bioRxiv: www.biorxiv.org/content/10.1...
We always see that 1) neural responses are very diverse 2) the shattering dimensionality is as high as it can be. Now also in an extensive analysis of the IBL dataset. Wonderful collaboration with @lorenzoposani.com, Shuqi Wang, Samuel Muscinelli, Liam Paninski. Many new analyses in this new version
Long-overdue thread on our latest work using the IBL data to reveal the shared organizational principles of the neural code in the cortex.
A systematic analysis of categoricality 🧱 and dimensionality 📐 of the neural code across 40+ cortical regions.
doi.org/10.1101/202...
👇 1/n
(1/5) Excited to share my work with @engeltatiana.bsky.social , out now in Nat Neuro! We show that RNNs use low-d latent circuit mechanisms for cognitive tasks. We find that context-dependent decisions in both RNNs and PFC arise from latent inhibitory mechanisms. www.nature.com/articles/s41...