Post

Why talk about how nuts the AI rationalist sex cult is, and not just focus on the (very real) risks and harms of AI? Well, when we're discussing "who should get to regulate AI, and how," I think it's VERY relevant to talk about the antisocial, unsettling ways many people running US AI think.

265 reposts1.2K likes

Yes. Whether we regulate AI barely matters if the cultists are the ones deciding. I would probably rather have Chinese govt AI than SV “rationalist” AI. And I don’t really want Chinese govt AI, so that’s saying something.

I suspect the most effective way to regulate AI is at the data layer with things like the EU's GDPR, the new Health Data Space and existing enforcing existing copyright law. Once data providence and protection is conceded its like stuffing the toothpaste back into the tube. 1/2

Especially in light of open source models proliferating on private machines that are largely beyond effective scrutiny into their inner workings. Is the data secure? Is there evidence of a breach? That's your easiest lift, all other bars are much harder to clear.

It also meets the cultural moment, people don't really care how AI works or what it can or can't do, its all about "you are doing something to my data, I may not understand what you did but I want you to stop doing it."

I’ve been saying all along that who trains/develops is critical…their synapses are AI, their priorities, their go-no-go inclinations, their values, their fetishes, their terrors, their drugs of choice on board. We know nothing because it’s not for ‘us’ to know…just to assume the position…

Tbf I didn't know any of that stuff and described the AI push as date-rapey. Because so many things I already used were forcing it and I didn't want it and they make it very hard to opt out. I'm not shocked they have a whole coercive personality.

They consider the people who already are and will be harmed to be unworthy, as opposed to the people like themselves who they DO consider to be worthy. And they do not live in our shared reality, so instead of REAL threats, they are focused on a fictional Machine God who they fear will harm them.

If we want to actually get a chance to regulate AI sensibly, we have to get these crazy millenarian cultist weirdos out of the powerful positions too many currently occupy. To accomplish that, we absolutely need more normal members of the public to realize that they *are* crazy weirdos.

On it.

Sean Satori@seansatori.bsky.social

Guys, I’m writing something about Roko’s Basilisk and why AI folks, both the effective altruists and the rationalists, have basically recreated something problematic from ancient religion without discovering how religion actually solved the problem.

It becomes a LOT easier to argue to the general public that we shouldn't let the AI industry regulate itself when you can ALSO produce clear evidence that much of the AI industry appears to be steered by genuinely crazy weirdos with anti-social and anti-human ideas.

I am intensely in favor of regulating AI (and I have been advocating for and reporting on ethical tech and tech regulations for a long time). But I'm afraid we won't get a chance to do that if the wacko millenarian cultist faction is able to control the regulatory process (as they're trying to do).

Of course, we can't exactly expect too much in the way of actually-good AI regulation under the disastrous Trump regime. But I do think we can fight to hold the line and demand sensible regulations that aren't steered by big tech and big money interests until 2028.

Who are also fucking each other and receiving money from each other left and right and are living in the same spaces and otherwise have 10 million very obvious conflicts of interest, any ONE of which might be disqualifying.

("To accomplish that, we absolutely need more normal members of the public to realize that they *are* crazy weirdos." I briefly parsed this as "the normies have to understand that it is they who are weird!".)

Eh, acts are just acts. What's unforgivable is leveraging professional power to prey on folks, many marginal, to extract sex, or vice versa. Unforgivable when a famous artist does it on campus speaking engagements, and when some nerd I don't give two shits about on a good day also does it.

After decades of breathless media sycophants hanging on the every word of Musk or Altman or Yud, it is so cathartic to just go "these are clowns who couldn't run a lemonade stand without burning it down by mistake, and who have beliefs so crazy L Ron Hubbard might have side-eyed them"

another aspect is that the one area where the most people come in contact with ai and its adjacent tech is the billionaires invading their communities and building their shit when those communities don’t want them! it’s malpractice that more democrats aren’t taking up this fight!