Roy Frostig

Roy Frostig

@froystig.bsky.social

research scientist at google deepmind. co-author of JAX (https://github.com/jax-ml/jax). https://cs.stanford.edu/~rfrostig

737 followers138 following5 posts

Roy Frostig reposted

Jeff Dean
@jeffdean.bsky.social

Training our most capable Gemini models relies heavily on our JAX software stack+Google's TPU hardware platforms. If you want to learn more, see this awesome book "How to Scale Your Model": jax-ml.github.io/scaling-book/ Put together by several of my Google DeepMind colleagues listed below 🎉.

jacobaustin123.bsky.social@jacobaustin123.bsky.social

Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n

Roy Frostig
@froystig.bsky.social

Our online book on systems principles of LLM scaling is live at jax-ml.github.io/scaling-book/ We hope that it helps you make the most of your computing resources. Enjoy!

jax-ml.github.io How To Scale Your Model Training LLMs often feels like alchemy, but understanding and optimizing the performance of your models doesn't have to. This book aims to demystify the science of scaling language models on TPUs: how...
jacobaustin123.bsky.social@jacobaustin123.bsky.social

Making LLMs run efficiently can feel scary, but scaling isn’t magic, it’s math! We wanted to demystify the “systems view” of LLMs and wrote a little textbook called “How To Scale Your Model” which we’re releasing today. 1/n

You are up to date.