"We're training a one million parame- huh? That's small?... uhh... okay, one bill- what, still not big enough? really? Okay, we're pre-training a TEN BILLION parameter model!"
Sources: ByteDance is pre-training an AI model with up to 10T parameters, roughly 3x Kimi K3 and potentially larger than estimates for Anthropic's Mythos 5 (Financial Times) Main Link | Techmeme Permalink
0 reposts0 likes