DurstewitzLab

DurstewitzLab

@durstewitzlab.bsky.social

Scientific AI/ machine learning, dynamical systems (reconstruction), generative surrogate models of brains & behavior, applications in neuroscience & mental health

1.1K followers1.8K following54 posts

In our #NeurIPS2026 paper “A Minimal Interpretable Architecture for Zero-Shot Reconstruction of Dynamical Systems” (preprint: arxiv.org/abs/2607.14937) we reduce a DS FM to ingredients minimally necessary to reproduce long-term stat. and geom. properties of DS, even outperforming many TS & DS FM.

In our #NeurIPS2026 paper “Topological Out-of-Domain Generalization in Dynamical Systems (DS) Reconstruction” (arxiv.org/abs/2606.22969) we aim to infer the DS generating observed TS jointly with control parameters, in order to extrapolate to different dynamical regimes, e.g. across tipping points.

In our #NeurIPS2026 spotlight “Parallel-in-Time Training of Recurrent Neural Networks for Dynamical Systems (DS) Reconstruction” (preprint: arxiv.org/abs/2605.12683) we speed up training of nonlinear RNNs on time series from chaotic DS by >100x by combining DEER with generalized teacher forcing.

In a #ICML2026 position paper we argue a dynamical systems perspective is needed to drive time series models forward: arxiv.org/abs/2602.16864 For TS, we need to move away from transformers that do not respect a system’s dynamical structure, esp. if out-of-domain generalization & insight is sought.

Neural ODEs are great as continuous-time dynamical systems, but slow and tedious to train. In a new #ICML2026 paper we intro a novel solver for continuous-time RNNs that does not rely on numerical integration. It's not only way faster & robust, but enables explicit analysis: arxiv.org/abs/2602.15649

DurstewitzLab reposted

i need the “llms are might be conscious” folx to read this

Jason Koebler@jasonkoebler.bsky.social

I met with AI data labelers in Kenya who are organizing their colleagues to fight the brutal working conditions and horrible pay given to the workers at the "bottom of the AI supply chain." They believe the NDAs they've signed are unenforceable so are speaking out: www.404media.co/ai-is-africa...

DurstewitzLab reposted

From the top of my head, here some recent ones: "Two views on the cognitive brain" by @johnwkrakauer.bsky.social, @dlbarack.bsky.social "Reconstructing computational system dynamics from neural data with recurrent neural networks" by @durstewitzlab.bsky.social et al 1/3

Nikolas Karalis@nikolaskaralis.bsky.social

I’m building a foundational reading list for our lab (systems & circuit neuroscience, compneuro, modeling, neuromodulators, population coding etc.). I’d like to crowdsource recommendations. Which review(s) would you consider mandatory reading for the next generation of researchers?

We had a go at a blog about our recent dynamical systems foundation model published at NeurIPS (with strong support from the Structures outreach team!) … let us know your thoughts!

With DynaMix, researchers bring ideas from physics into machine learning to uncover the dynamics underlying complex data. Learn all about this on the new post by Daniel Durstewitz @durstewitzlab.bsky.social and Christoph Hemmer: structures.uni-heidelberg.de/blog/posts/2... 2/2 #Dynamics #AI

Unlike current AI systems, animals can quickly and flexibly adapt to changing environments. This is the topic of our new perspective in Nature MI (rdcu.be/eSeif), where we relate dynamical and plasticity mechanisms in the brain to in-context and continual learning in AI. #NeuroAI

rdcu.beWhat neuroscience can tell AI about learning in continuously changing environmentsNature Machine Intelligence - Durstewitz et al. explore what artificial intelligence can learn from the brain’s ability to adjust quickly to changing environments. By linking neuroscience...

Revised version of our #NeurIPS2025 paper with full code base in Julia & Python now online, see arxiv.org/abs/2505.13192

arxiv.orgTrue Zero-Shot Inference of Dynamical Systems Preserving Long-Term StatisticsComplex, temporally evolving phenomena, from climate to brain activity, are governed by dynamical systems (DS). DS reconstruction (DSR) seeks to infer generative surrogate models of these from observe...
DurstewitzLab@durstewitzlab.bsky.social

Our #AI #DynamicalSystems #FoundationModel DynaMix was accepted to #NeurIPS2025 with outstanding reviews (6555) – first model which can *zero-shot*, w/o any fine-tuning, forecast the *long-term statistics* of time series provided a context. Test it on #HuggingFace: huggingface.co/spaces/Durst...

Our #AI #DynamicalSystems #FoundationModel DynaMix was accepted to #NeurIPS2025 with outstanding reviews (6555) – first model which can *zero-shot*, w/o any fine-tuning, forecast the *long-term statistics* of time series provided a context. Test it on #HuggingFace: huggingface.co/spaces/Durst...

huggingface.coDynaMix - a Hugging Face Space by DurstewitzLabUpload your time series data in CSV or NPY format and generate future forecasts. Configure the forecast length and settings, then download the results as CSV or NPY.
DurstewitzLab@durstewitzlab.bsky.social

Can time series (TS) #FoundationModels (FM) like Chronos zero-shot generalize to unseen #DynamicalSystems (DS)? No, they cannot! But *DynaMix* can, the first TS/DS FM based on principles of DS reconstruction, capturing the long-term evolution of out-of-domain DS: arxiv.org/pdf/2505.131... (1/6)

Despite being extremely lightweight (only 0.1% of params, 0.6% training corpus size, of closest competitor), it also outperforms major TS foundation models like Chronos variants on real-world TS forecasting with minimal inference times (0.2%) ...

Got prov. approval for 2 major grants in Neuro-AI & Dynamical Systems Reconstruction, on learning & inference in non-stationary environments, out-of-domain generalization, and DS foundation models. To all AI/math/DS enthusiasts: Expect job announcements (PhD/PostDoc) soon! Feel free to get in touch.

We wrote a little #NeuroAI piece about in-context learning & neural dynamics vs. continual learning & plasticity, both mechanisms to flexibly adapt to changing environments: arxiv.org/abs/2507.02103 We relate this to non-stationary rule learning tasks with rapid performance jumps. Feedback welcome!

arxiv.orgWhat Neuroscience Can Teach AI About Learning in Continuously Changing EnvironmentsModern AI models, such as large language models, are usually trained once on a huge corpus of data, potentially fine-tuned for a specific task, and then deployed with fixed parameters. Their training ...

How do animals learn new rules? By systematically testing diff. behavioral strategies, guided by selective attn. to rule-relevant cues: rdcu.be/etlRV Akin to in-context learning in AI, strategy selection depends on the animals' "training set" (prior experience), with similar repr. in rats & humans.

rdcu.beAbstract rule learning promotes cognitive flexibility in complex environments across speciesNature Communications - Whether neurocomputational mechanisms that speed up human learning in changing environments also exist in other species remains unclear. Here, the authors show that both...

DurstewitzLab reposted

Into population dynamics? Coming to #CNS2025 but not quite ready to head home? Come join us! at the Symposium on "Neural Population Dynamics and Latent Representations"! 🧠 📆 July 10th 📍 Scuola Superiore Sant’Anna, Pisa (and online) 👉 Free registration: neurobridge-tne.github.io #compneuro

I’m really looking so much forward to this! In wonderful Pisa!

Eleonora Russo@russoel.bsky.social

Into population dynamics? Coming to #CNS2025 but not quite ready to head home? Come join us! at the Symposium on "Neural Population Dynamics and Latent Representations"! 🧠 📆 July 10th 📍 Scuola Superiore Sant’Anna, Pisa (and online) 👉 Free registration: neurobridge-tne.github.io #compneuro

Just heading back from a fantastic workshop on neural dynamics at Gatsby/ London, organized by Tatiana Engel, Bruno Averbeck, & Peter Latham. Enjoyed seeing so many old friends, Memming Park, Carlos Brody, Wulfram Gerstner, Nicolas Brunel & many others … Discussed our recent DS foundation models …

View full thread

We dive a bit into the reasons why current time series FMs not trained for DS reconstruction fail, and conclude that a DS perspective on time series forecasting & models may help to advance the #TimeSeriesAnalysis field. (6/6)

View full thread

It often even outperforms TS FMs on forecasting diverse empirical time series, like weather, traffic, or medical data, typically used to train TS FMs. This is surprising, cos DynaMix’ training corpus consists *solely* of simulated limit cycles & chaotic systems, no empirical data at all! (3/6)

Unlike TS FMs, DynaMix exhibits #ZeroShotLearning of long-term stats of unseen DS, incl. attractor geometry & power spectrum, w/o *any* re-training, just from a context signal. It does so with only 0.1% of the parameters of Chronos & 10x faster inference times than the closest competitor. (2/6)

I'm presenting our lab's work on *learning generative dynamical systems models from multi-modal and multi-subject data* in the world-wide theoretical neurosci seminar Wed 23rd, 11am ET: www.wwtns.online --> incl. recent work on building foundation models for #dynamical-systems reconstruction #AI 🧪

wwtns.onlineHome | Neuroscience | World Wide Theoretical Neuroscience SeminarWWTNS is a weekly digital seminar on Zoom targeting the theoretical neuroscience community. Its aim is to be a platform to exchange ideas among theoreticians.

DurstewitzLab reposted

Our revised #iclr2025 paper and codebase for an architecture for foundation models for dynamical systems reconstruction is now online: openreview.net/pdf?id=Vp2OA... ... includes additional examples of how this may be harvested for identifying drivers (control par.) of non-stationary processes.

openreview.netopenreview.net
DurstewitzLab@durstewitzlab.bsky.social

Toward interpretable #AI foundation models for #DynamicalSystems reconstruction: Our paper on transfer & few-shot learning for dynamical systems just got accepted for #ICLR2025 ! Previous version: arxiv.org/pdf/2410.04814; strongly updated version will be available soon ... (1/4)

View full thread

This gives rise to an interpretable latent feature space, where datasets with similar dynamics cluster. Intriguingly, this clustering according to *dynamical systems features* led to much better separation of groups than could be achieved by more trad. time series features. (3/4)

We show applications like transfer & few-shot learning, but most interestingly perhaps, subject/system-specific features were often linearly related to control parameters of the underlying dynamical system trained on … (2/4)

That paper discusses an important issue for RNNs as used in neurosci. But we would argue that many RNN approaches do not truly reconstruct DS, for which we demand also agreement in long-term stats, attractor geometry, and generative perform. (esp. in chaotic systems, MSE as stats can be misleading).

Luke Sjulson@lukesjulson.bsky.social

Honest question, not meant as inflammatory: what do you think of this? bsky.app/profile/bqia... I am very interested in using DSR with our data, but I’m not sure what to make of it

Also important to keep in mind that different network architectures may be compatible with the same *dynamical mechanisms*, so one needs to be careful with the level at which one seeks interpretation & insight.

DurstewitzLab reposted

Great to see this group on Bluesky. Durstewitz and Seamans 2008 is one of my all time favorite papers on the function of dopamine in the PFC www.researchgate.net/profile/Dani...

researchgate.netresearchgate.net
DurstewitzLab@durstewitzlab.bsky.social

Now may be a good time to introduce our group on bsky with some of our contrib. to dynamical systems reconstruction (DSR) from past year. By DSR we mean learning a *generative surrogate model* of a dyn. process from TS data which reproduces full attractor & generalizes to new init. conditions (1/6)