Post

Slow down frontier model development. Bring open weights to current frontier. Build out local inference providers, stabilize hardware prices, focus on cost and token throughput for a bit. Get our software updated to handle what's being thrown at us. I would not mind spending a beat on distribution.

Do you realize how massively tokens are subsidized today? So many people got used to buying $40 bills for $1, built workflows around them, and now ask for "someone" to "bring the cost down". However, the bad news that serving LLMs is deeply, structurally unprofitable. And is only getting worse.

The first "L" in "LLM"s is the problem. This is not a small issue that can be tweaked. The whole idea of building massive models that both train on the history of the Roman Empire and also on a bunch of stolen JavaScript code is absurd. Without massive VCs subsidies, this would have never happened