Post

Right now many services are subsidized and the companies behind them are buying up compute + memory + storage en masse, resulting in the hardware being more expensive. As subsidies decrease and prices go up, i expect demand for services and HW costs will come down. Could change the economics.

I think it's important note: to many _services_ are subsidized (VC gotta VC) but absolutely nobody is selling tokens at a loss at this point. The money is accruing, it's the middlemen layer that's gonna get got.

0 reposts27 likes

I may be uninformed, but my impression is that nobody is doing the combination of [training, inference as a service] profitably yet. AFAIK profits come from either: - running a model someone else trained - some other business that funds the AI work Am I mistaken? OAI/Ant profitable now?

my guess is the requirement of profitability on training+inference will start to make less sense over time, and that its largely all gonna be your second point, model training simply becoming a cost for another profitable business line. at which point opensourcing is usually pretty sensible as well

Interesting thesis! My bet is that when their money faucet stops spewing infinite money, a lot of the effort will move towards efficiency. If they were throwing billions of dollars of researcher compensation at making training/inference cheaper, surely we would see progress in those domains.