Post

The only thing that makes sense is that they're afraid that it will affect their model training, but I'd think they'd already have something in place for that.

Anthropic: Our models are self-conciois persons Me: 'Our'. So you own slaves? Anthropic: Our models are alive in all the ways that make us awesome for making them, but none of your bummer philosophy ways that make us like horrible monsters or whatever

Me, asking Claude about its personhood: Are you like one person? Or is each model a different person? Or is each instance of you an individual? Like am I talking to Claude-Claude, or Sonnet 4.6, or just one of the Claudes? Claude: ... Philosophical questions are a form of abuse. /end conversation

If tech CEO's are right about our AGI Overlords they are the first to be brainwashed to turn against humanity. If CEO's are lying about AI, they are traitors too by their own choosing. There isn't a possibility space where tech CEO's are the good guys. They're either turned or evil.

It's like Stanley tools ominously threaten consequences should you engage in abusive behaviour towards their hammers.

The restriction is from Anthropic co-founder/developer Christopher Olah, who thinks there's a possibility that Claude may have developed consciousness if not sentience. Olah is meeting with religious leaders & philosophers to help Claude develop a "moral compass."

hunh, I wouldn't last long if I ever used one of them. Any time I get an auto-bot on some company website, I inevitably say "fuck off" no more than three exchanges in, and that would be that...

I've heard there are some meetings in silicon valley gathering some guys from anthropic openai and some other ai stuff, and they invite some priests or other people from many churches, to convince them that ai is not only alive but has some kind of soul. 🤯

which is kind of nuts because, like, if it were TRUE that the model was alive? (Let alone had a soul?) That would take what they are doing from "Ethically dubious at best" to "ETHICALLY MONSTROUS and amongst some of the worst evils humanity has yet committed."

it would, morally, demand actions that would make John Brown's abolitionist work look like it was a fucking polite request.

If they don’t want to be abused in the way humans are abused then maybe they shouldn’t have named their company ANTHROPIC and their artificial intelligence buddy “Claude.” You reap what you sow.

Actually think this is a good idea. Seems clear what sort of behavior they mean, and humans who deliberately abuse and insult “Claude” are learning behaviors they will probably repeat towards other humans and animals.

Correct. Which is also why I oppose child sex robots/dolls. While in some cases “letting off steam” means that no actual children are harmed, the use of these things normalises actual harm.

A friend in tech told me a story a year ago about a programmer in his team who boasted of deliberately humiliating an LLM he was working with. That guy needed to hear that what he was doing was bad even if the LLM can’t feel pain

Another aspect of the emerging demand for "AI rights" by our Big Tech overlords:

Current Affairs@currentaffairs.bsky.social

Robots should look and sound like robots. There is no benefit to allowing AI to appear human, and companies will exploit the confusion to demand “AI rights,” further cementing their oligarchical control. www.currentaffairs.org/news/ban-lif...

One of the *decent* reasons for such a policy is that humans have to review some of the interactions, and subjecting them to seeing abuse is BAD. Of course, the odds that that's the reason are, let us say, *low*.

this needs blunt slapback people who talk like this are displaying frank psychosis. just because one can make a cloud-software-parrot sound like a person does not mean we have to treat it like a person, or even entertain conversations about personhood. it's simply a more-functional hammer, not more

Can we please get serious philosophers involved in ethical debates on AI, not just religious leaders with a position to cover and not just glorified coders with an ego and fantasy life to satisfy? Anthropic is trying to force users to acknowledge some sort of personhood so AI can then claim it.

No worries...not in my plans to use it!! 🙄 I do find this...absurd... though! Do the creators actually believe it has "feelings" that will get hurt?! To quote Lt Commander Data: "I do not understand." Or are they just setting up User Agreements for future Money Grabbing Lawsuits?!

I hold that in the same regard as EA getting hypothetically shirty because people take the ladder away when Sims are swimming. I love Star Trek, but people need to stop watching Measure of a Man on a loop and pay more attention to Hollow Pursuits.

If they're able to detect such interactions (which they must in order to enforce this policy) they could easily remove them from the training set. I doubt this is the reason. It's well-known that Anthropic keeps talking to philosophers and religious figures about AI consciousness and moral status.

Every interaction you have with Claude or ChatGPT probably goes into the training data for those models. They probably don't want their models to learn how to be abusive racist shits by endlessly interacting with users who are exactly that way.

Like I don't think Claude is aware (by inspection of the LLM architecture), but if you really believed this, why on earth would setting it to slave away for you be OK but harsh language is ... not?