Dileep George @dileeplearning

Dileep George @dileeplearning

@dileeplearning.bsky.social

AGI research @DeepMind. Ex cofounder & CTO Vicarious AI (acqd by Alphabet), Cofounder Numenta Triply EE (BTech IIT-Mumbai, MS&PhD Stanford). #AGIComics blog.dileeplearning.com

11.9K followers694 following344 posts

I'll be at Cosyne workshops next week (16th and 17th). We are hiring at Astera NeuroAI. If you are at Cosyne workshops next week and want to learn more about this exciting research team we are building at Astera, please DM me or email me at dileep@astera.org

News! I've joined the Astera Institute to lead its neuroscience based AGI research. Backed by $1B+ commitment over the coming decade, my team will explore novel, brain-inspired architectures and algos toward safe, efficient human-like AGI, working alongside Doris Tsao. 1/ astera.org/dileep-georg...

astera.orgDileep George joins Astera to lead its neuro-inspired AGI effortDileep George is joining Astera as Head of AI, leading our AGI research division. Working alongside our Chief Scientist Doris Tsao, he and the team will explore novel, brain-inspired computational arc...

Dileep George @dileeplearning reposted

๐Ÿงต1/12 What if the DMN, limbic system, hippocampus, neural oscillations, gradients, dementia syndromes, mixed pathology, and aphantasia all fall out of the same generative brain computation? ๐Ÿคฏ#endalz Introducing #SLOD (preprint): a new #NeuroAI framework w/ @drbreaky.bsky.social

Dileep George @dileeplearning reposted

Replying to @simonsinstitute.bsky.social

4/4 โ€œLanguage is a mechanism to control other peopleโ€™s mental simulations.โ€ Dileep George, @dileeplearning, of @GoogleDeepMind at the Simons Institute workshop on The Future of Language Models and Transformers. Video: simons.berkeley.edu/talks/dileep...

simons.berkeley.eduOn cognitive maps, LLMs, world models, and understandingNo abstract available.

Dileep George @dileeplearning reposted

1/4) Iโ€™m excited to announce that I have joined the Paradigms of Intelligence team at Google (github.com/paradigms-of...)! Our team, led by @blaiseaguera.bsky.social, is bringing forward the next stage of AI by pushing on some of the assumptions that underpin current ML. #MLSky #AI #neuroscience

github.comParadigms of Intelligence TeamAdvance our understanding of how intelligence evolves to develop new technologies for the benefit of humanity and other sentient life - Paradigms of Intelligence Team

Dileep George @dileeplearning reposted

1/ ๐Ÿšจ New preprint! ๐Ÿšจ Excited and proud (& a little nervous ๐Ÿ˜…) to share our latest work on the importance of #theta-timescale spiking during #locomotion in #learning. If you care about how organisms learn, buckle up. ๐Ÿงต๐Ÿ‘‡ ๐Ÿ“„ www.biorxiv.org/content/10.1... ๐Ÿ’ป code + data ๐Ÿ”— below ๐Ÿคฉ #neuroskyence

Hmmโ€ฆI donโ€™t think itโ€™s impossible. Evolution could create structures in the brain that are in correspondence with structure in the world.

Blake Richards@tyrellturing.bsky.social

Dear neuroscientists, The brain cannot generate information about the world de novo, it's impossible. All the brain can do is: 1. Selectively remove info that is irrelevant. 2. Re-emit info previously absorbed via evolution or memory. Our brain never "creates" information. Never. ๐Ÿง ๐Ÿ“ˆ ๐Ÿงช

This paper turned up on a feed, I was intrigued by it and started reading... ..but then I was quite baffled because our CSCG work seem to have tackled many of these problems in a more general setting and it's not even mentioned! So I asked ChatGPT... ...I'm impressed by the answer1. 1/๐Ÿงต

View full thread

This paper turned up on a feed, I was intrigued by it and started reading... ..but then I was quite baffled because our CSCG work seem to have tackled many of these problems in a more general setting and it's not even mentioned! So I asked ChatGPT... ...I'm impressed by the answer1. 1/๐Ÿงต

View full thread

This paper turned up on a feed, I was intrigued by it and started reading... ..but then I was quite baffled because our CSCG work seem to have tackled many of these problems in a more general setting and it's not even mentioned! So I asked ChatGPT... ...I'm impressed by the answer1. 1/๐Ÿงต

Dileep George @dileeplearning reposted

๐—›๐—ผ๐˜„ ๐˜€๐—ต๐—ผ๐˜‚๐—น๐—ฑ ๐˜„๐—ฒ ๐—ฑ๐—ฒ๐—ณ๐—ถ๐—ป๐—ฒ ๐—ฎ๐—ป๐—ฑ ๐—ฑ๐—ฒ๐˜๐—ฒ๐—ฟ๐—บ๐—ถ๐—ป๐—ฒ ๐—ฎ ๐—ฏ๐—ฟ๐—ฎ๐—ถ๐—ป ๐—ฟ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป'๐˜€ ๐—ถ๐—บ๐—ฝ๐—ผ๐—ฟ๐˜๐—ฎ๐—ป๐—ฐ๐—ฒ? We introduce the idea of "importance" in terms of the extent to which a region's signals steer/contribute to brain dynamics as a function of brain state. Work by @codejoydo.bsky.social elifesciences.org/reviewed-pre...

elifesciences.orgBrain dynamics and spatiotemporal trajectories during threat processing

It's kinda obvious. #AGIComics has already figured out which brain region is the most important. ๐Ÿ˜‡

PessoaBrain@pessoabrain.bsky.social

๐—›๐—ผ๐˜„ ๐˜€๐—ต๐—ผ๐˜‚๐—น๐—ฑ ๐˜„๐—ฒ ๐—ฑ๐—ฒ๐—ณ๐—ถ๐—ป๐—ฒ ๐—ฎ๐—ป๐—ฑ ๐—ฑ๐—ฒ๐˜๐—ฒ๐—ฟ๐—บ๐—ถ๐—ป๐—ฒ ๐—ฎ ๐—ฏ๐—ฟ๐—ฎ๐—ถ๐—ป ๐—ฟ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป'๐˜€ ๐—ถ๐—บ๐—ฝ๐—ผ๐—ฟ๐˜๐—ฎ๐—ป๐—ฐ๐—ฒ? We introduce the idea of "importance" in terms of the extent to which a region's signals steer/contribute to brain dynamics as a function of brain state. Work by @codejoydo.bsky.social elifesciences.org/reviewed-pre...

ohh...yes...this is exactly what I think after reading some of the "deep research" reports. ....written by a committee

Carl T. Bergstrom@carlbergstrom.com

Worthwhile reading. Some of the features that John rightly criticizes in AI writing are shared by the sort of committee reports and consensus papers that emerge from workshops and symposia because someone felt that there had to be a โ€œproductโ€œ associated with the meeting.

Dileep George @dileeplearning reposted

jumping on the Gemini 2.5 bandwagon... it's an incredible model. really feels like an(other) inflection point. talking to Claude 3.7 feels like talking to a competent colleague who knows about everything, but makes mistakes. Gemini 2.5 feels like talking to a world-class expert with A+ intuitions

Nope. It is an engineering problem. Give me an algorithm you think is not being scaled because of a hardware mismatch, I can make the hardware (chip + interconnect + datacenter) given enough money. Purely an engineering problem.

Blake Richards@tyrellturing.bsky.social

No you can't - that is super non-trivial. Building hardware to run a specific algorithm is hard enough. Building hardware that can run a specific algorithm *and* scale up to billions of parameters is super duper hard. It's not just a matter of money... It's a scientific problem!

ok...in that case which other existing model would you make a bet on scaling up? Pick one. I'd be happy to raise money for it.

Blake Richards@tyrellturing.bsky.social

Well, that's the kind of thing one would have to demonstrate. As to SOTA - transformers are likely SOTA because they scale so well, which is largely because they won the "hardware lottery". I am willing to bet other models would be SOTA if we could train them at similar scales.

This is great....this is a hypothesis. What other such hypotheses are there? Is there a space of such hypotheses, or is this just one? (Also, how does this match with Konrad's @kordinglab.bsky.social argument about being hypothesis-free?)

Blake Richards@tyrellturing.bsky.social

There are numerous differences at the algorithmic level between cortical circuits and transformers (and you know that, of course). I'll give just one example: In the brain, attention mechanisms often operate in a top-down manner, something missing from most transformer models.

Here's my Q to @kordinglab.bsky.social who argues brain is too complex to understand.... How do you know that current systems AI are NOT how the brain works?

Konrad Kording@kordinglab.bsky.social

Accepting โ€œthe bitter lessonโ€ and embracing the brainโ€™s complexity by Dyer and Richards. Great article! www.thetransmitter.org/neuroai/acce...

TLDR: We need large amounts of data to finally show that brain is a large transformer that we cannot understand. ๐Ÿ˜‡๐Ÿ˜

Blake Richards@tyrellturing.bsky.social

Eva Dyer and I wrote an opinion piece for @thetransmitter.bsky.social on why neuroscience needs to embrace complexity and accept the "bitter lesson" by using a data-driven regime at scale. With commentary from several wonderful researchers! ๐Ÿง ๐Ÿ“ˆ #NeuroAI ๐Ÿงช

The bitter lesson is that neuroscience seems to be out of ideas... ๐Ÿ˜‡

Konrad Kording@kordinglab.bsky.social

Accepting โ€œthe bitter lessonโ€ and embracing the brainโ€™s complexity by Dyer and Richards. Great article! www.thetransmitter.org/neuroai/acce...

Although Konrad is being brief here, the idea that โ€œANN are now often part of normative models and they are definitely SOTAโ€ is something I see often. Including a component that is sota elsewhere doesnโ€™t make a model any better. It is very possible to build sucky models with ANN.

Konrad Kording@kordinglab.bsky.social

To me this is decisively an orthogonal direction and the does not work is a very limited take. Eg kalman filters often appear in normative models and they were competitive at a time. And Ann now often are part of normative models and they definitely are sota.

If it doesnโ€™t work, itโ€™s called a normative model. Otherwise itโ€™s a just a model. ๐Ÿ˜‡

Konrad Kording@kordinglab.bsky.social

Wrote a post explaining the logic of normative modeling - which is one of the reasons why I am trying to be precise about what is predicted by models from which assumptions. open.substack.com/pub/kording/...

Dileep George @dileeplearning reposted

Replying to @tdietterich.bsky.social

This remains important today. As industry places huge financial bets on large language models, the research community needs to investigate other approaches that may achieve similar or better results via entirely different methods. end/