Post

the fundamental issue with AI has ALWAYS BEEN that it CAN'T do precisely what you intend because prompts are lossy compression you can't control the decompression of. that is what the technology **IS** now they are rebranding that as "lack of alignment" as if it wasn't present from their inception

If you’re a normal person whose not in tech I wrote an essay explaining where I think we are at with the news of frontier labs deciding to slow down model progress unilaterally together and what it really means for regular humans. It tries to start from first principles and explain things well.

10 reposts36 likes

Something I find frustrating is that I think LLMs are incredibly useful. However, the problem isn't necessarily their capabilities, it's that people grossly misunderstand and don't attempt to actually understand the capabilities.

I did end up paying $100/mo for Claude and I was having a blast. But that pretty quickly ended when I realized that it is only as good as I am. I still need to put in the effort to do the engineering behind whatever I create. I need to do the fact checking. I need to understand the commands.

I think they are useful as semantic search engines, especially if you're trying to navigate your own data. But I think we need regulations for standardization of performance expectations and holding companies accountable for grossly over promising the capabilities of these things.

And given all of this, I think one way to achieve that is to do the enforcement of copyright that we've been wanting this whole time. Forcing companies to have to respect copyright and suing them into the ground would force these models to slow down and our expectations to be curbed.

Kind of incredible the author brings up the fact that ai companies have historically held back new models to generate hype ("safety concerns") and then somehow fails to acknowledge that they MIGHT be doing the same thing now with this "slow down."

the big tech companies overpromised, and like with crypto before it, they have run face first into the nature of the technology not it's limits. what it *is*, specifically. all their promises depended on convincing you it wasn't constrained by its nature it was a lie, as always