Post

legit, I do not think we need better large models than we have now and I’m still not seeing substantial improvement in the places where models are struggling. the trend is to topically RL harder and to try to just make them guess your under-specified prompts better and I think that’s a mug’s game

Ed@ed3d.net

No, I think that's still true, but lots of people are selling inference while not doing training, and that shouldn't be forgotten. And OAI/Anthropic's training budgets, tbh, don't really interest me now either -- we are at the stage where model dev could 100% stop and we would be Just Fine, so, eh.

I think the recent improvements in vision on the frontier models have been very useful, we could really use some focus along the more secondary axes like that.

0 reposts0 likes

No replies yet.