Post

Newsletter: I am sick and god damn tired of everybody pretending that generative AI is the next big thing. The media is complicit in accepting fantastical nonsense - both in the numbers put out by OpenAI and the silly jobs created by Anthropic - and it has to stop. www.wheresyoured.at/reality-check/

wheresyoured.atReality CheckI'm sick and god-damn tired of this! I have written tens of thousands of words about this and still, to this day, people are babbling about the "AI revolution" as the sky rains blood and crevices open...

Generative AI is a remarkable con — a just-good-enough simulacrum of human expression to get it past the gatekeepers in finance and the media, knowing that neither will apply a second gear of critical thinking beyond "huh guess we're doing AI now." It's a disgrace. www.wheresyoured.at/reality-check/

The generative AI bubble - by which I mean the growth of ChatGPT - grew in part thanks to Google Search's failure to innovate. Most people I know who use ChatGPT do so for search, as Google has got so much worse at understanding what it is you're searching for. www.wheresyoured.at/reality-check/

23 reposts399 likes

I do think AGI or something like it is possible with current technology and known methods, but there's no chance the gen AI companies will pivot because I don't think they even want it. It'd eat into their investments if they actually produced the goose. And they've also convinced themselves...

And no that method is not generative AI. Back in 2020 and 2021 I was excited by transformers as one of the architectural components of a more advanced AI. 5 years later we're still boosting attention-based transformers and claiming they're going to get us to the Singularity. What is this clownfest??

It's sad how little we invested on new architectures. Everyone put billions into training the same models to gain 0.1 % on MMLU. Sure, new architectures like Titans might power Gemini 2.5 which partly solved context degradation over 80k tokens. But the Agent dream isn't achievable, it's too late.