Post

4x token throughput on NVIDIA's Nemotron 3 Nano. 1M context window. We've been testing inference costs across our clients' projects. Parameter count stopped mattering 6 months ago. Cost per token is all anyone asks about now. The "biggest model" era is over.