Post

I love some good ol-fashioned data center porn But I have some questions engineering.fb.com/2026/10/19/d...

They started with GB200 NVL72 racks with the following stats

They upgraded to GB300 NVL72 racks with a bullet point that it has over 1 exoFLOP of FP4 compute. The GB200 rack says it has 1.4 exoFLOP of FP4 compute they just wrote it as "1,440 PFLOPS"

Are you telling me that last year with GB200 12% of your GPUs were "interrupting" every day??? The stat says 1000 failures per 8000 GPUs per day. That's 1 in 8. IDK about you, but to me that sounds like a completely broken product

Their goal is 1M GPUs and let's just use 72 GPU/rack as a round number. That means they have 13,888 active racks and 277 SPARES!!! A GB300 NVL72 rack costs about $5,000,000 which means they have (list price) $1.3B of spare capacity

But gpu has a relatively high burn/failure rate, so without redundancy, they will need to repair/decommission full rack

If I ever started working with a product that had a 12% failure rate I would stop using that product immediately

This really makes me think how much the frontier labs are spending when they rent the entire infrastructure from hyperscalers Datacenters are expensive. Not owning the infrastructure is expensive and risky

Yup all these numbers seem about right to me. Although I would’ve expected more hardware failure and a higher reserve rate to try and account for hardware shortages. Would’ve expected 22-25% reserve maybe to factor in growth as well. I’m guessing the board shot that down?