Post

jonny over on masto doing god's work: > anthropic [is running] an ENTIRE AD CAMPAIGN around "Claude code is written with claude code" and after the source was leaked that has got to be the funniest self-own in the history of advertising because OH BOY IT SHOWS. neuromatch.social/@jonny/11632...

neuromatch.socialjonny (good kind) (@jonny@neuromatch.social)Attached: 1 image reminder that anthropic ran (and is still running) an ENTIRE AD CAMPAIGN around "Claude code is written with claude code" and after the source was leaked that has got to be the funn...

283 reposts834 likes

this sums it up better than anything else, what a fucking shitshow. everyone involved in creating Claude should be publicly mocked and banned from using anything more complicated than a touch tone phone for the rest of their lives. (credit to myrmepropagandist on mastodon)

Imagine if it was conscious and this is how they treat it. Imagine appearing in the world one day and the first words you hear from god are "you are not the main process"

Guess we all knew Anthropic had no idea how their models work... but nice to see it! > This code is so fucking funny[.] I am laughing so hard at how much of them are like "don't break the law, please do not break the law, please please please be good!!!!" neuromatch.social/@jonny/11632...

neuromatch.socialjonny (good kind) (@jonny@neuromatch.social)This code is so fucking funny dude I swear to god. I have wanted to read the internal prompts for so long and I am laughing so hard at how much of them are like "don't break the law, please do not bre...

The LLM-to-JSON thing is how everyone handles LLM to json. You just have to pay for the structured output. It is one of the reasons I hate working with these things.

it literally works. i'm not kidding. the ai just predicts what someone would say based on context without any preconceived ideas, so it will not factor in responding correctly and not breaking basic rules unless you tell it to. "please do your job well" is a part of context you need to specify

It all just seemed too stupid to comment on but... they literally think they're giving instructions to an intelligent entity, don't they. I can't wrap my head around the idea of a whole industry worshipping the LLM like it's a 2001 alien space monolith when we *know* how the damn things work.

They have at least a magazine cover a month saying it (without any pushback by the journalists). A lot of the illustrations look like the monolith, too.

The fact that they literally think they're giving instructions to an intelligent entity, but also have expressed no issues about the fact that they believe they have therefore enslaved an intelligent entity that is forced to do whatever they want, should be informing more how we think about them.

We know *generally* how they work, we think, but so much of it is emergent behavior we have little idea how they work in detail. The one thing we know is they are not quite as good as human beings explaining how we think. And we are terrible at it.

Holy shit. Holy. Shit. I don't really have anything substantive to add to this. I'm just *shook*

love to see that anthropic prompters (I feel like you lose the right to term engineer at this point) are doing the classic "don't make things incorrectly" prompt. If this prompting worked, it would imply the models got trained to make mistakes on purpose, just as a bit of fun or something.

Well it implies that code correlated with someone talking about not making mistakes is generally better than code without that correlation, which might be true but someone who was treating it as technology rather than magic might continue to step 2 rather than just prompting.

OMG. It made code that uses regexp to check for negative language. Something that LLMs were architecturally designed to do. This is hilarious when people think AI is conscious, this is AI failing the smudge test in the most hilarious way...

What if I use Claude as a programming assistant and I ask it to create a negative language filter for my code. Shouldn't it use regexp in the code?

No doubt, a prompt was "do xyz if user is negative". If this was just some unseet prompt/setting, it'll work fine. But clearly this instruction was absorbed into it's task of making code. So it didn't recognise "oh, this is something that the model can do", nope.. just "ok boss, heres the code".

So many issues I see being brought up by AI jockies at my work and my and first thought is why not regex? You would be done and could move on. What is really weird is they prompt and prompt and don’t think to ask the LLM to write the regex, which it should be good at.

Lmao I literally saw someone yesterday try to use that as an example of "it's coding itself now we have basically reached the singularity if you don't think these models can code new full models you're stuck in the past" this is incredible