Post

If you read nothing else about AI this week, read this - absolutely fascinating, ties together a whole bunch of recent developments in the field Wrote my own notes here but really this piece defies summarization, you should absorb the whole thing simonwillison.net/2024/Dec/19/...

Arvind Narayanan@randomwalker.bsky.social

New AI Snake Oil essay: Last month the AI industry's narrative suddenly flipped — model scaling is dead, but "inference scaling" is taking over. This has left people outside AI confused. What changed? Is AI capability progress slowing? We look at the evidence. 🧵 www.aisnakeoil.com/p/is-ai-prog...

18 reposts95 likes

I've been turning this over in my brain grapes all week. I think the scaling slow down narrative is effectively if not literally bunk. Synthetic data models will start encoding more and more logic functions into the LLMs output. And even if im completely wrong, combined systems will zoom

@richardelm.bsky.social The point about applications is well-made and important. I’m building atop LLMs and transformer models and the tools are stone knives-and-bearskins level of sophistication, we’ve barely even scratched the surface of what prompting can do, let alone rigorous testing.

Thanks, Simon!! You're too kind. And thank you for your insightful blog, from which we've learned a lot. Just a small note that Benedikt Ströbl is one of the authors; he is credited in the byline but doesn't show up at the top because he is not a poster on our Substack.