It's the small things. NVIDIA like to focus on hardware that makes the cost of electricity a rounding error in the total cost of ownership, making life much simpler for everyone with $100k in change hiding in their sofa. (I roughly costed £7.5k over three years to run this at 50% capacity)
I want 4x of these so bad. But instead, I'll probably end up with 10x RTX PRO / Instinct PCIe cards running Qwen 27B instead. It's a whole lot more affordable.
0 reposts0 likes