Post

"surely it is insidious Chinese propaganda that's making normal people hate and fear us, instead of how we say stuff like this on main all the time" - the big American genAI companies

183 reposts1K likes

the frontier genAI companies really have completely lost the ability to identify when they're saying things that make them sound completely batshit and irresponsible to the general public. who will see something like this and go "well, if you think it'll kill us all, maybe stop building it?"

I don't actually *disagree* with what Jason Wolfe is saying here - we DO need to work together to deal with AI safety issues, we DO need caution and humility - but when this is coming from a person who has a very lucrative job at a company that's barreling full-steam ahead with these tools, well...

No one who thinks a conversational interface is reasonable actually cares about safety so I just straight up don’t believe this guy, though I’m willing to believe *he* believes all that: bsky.app/profile/jman...

Josh@jman4747.bsky.social

Nor is there ever any acknowledgment that having a conversational interface is unnecessary and extremely dangerous. No one ever suggests building something similar sans that features and it’s frankly suspicious, given how many people get pulled into cult dynamics-

But they're not framing it as "misuse of this technology has turned it into a probability-based plagiarism and CSAM chop shop, and people treating it as an oracle are breaking their brains." They're saying, "We are creating The Thing That Will Be God and we dare not anger it lest it destroy us."

It's all an attempt to shift responsibility off of the people trying to destroy the world for profit, and onto the machine they're using to do it. They want us to focus on The Ford Pinto as an entity rather than the engineers who built it and the corporate creatures who hid its flaws.

it comes off as Guys Building The Doom Machines standing around and going "the doom machines could quite likely kill us all, and we should coordinate on stopping them from killing us all, although I *personally* am going to keep focusing on becoming ultra-rich from building the Doom Machines"

oh, i finally figured out what it reminds me of. that one moment waaaaaaaaay back in some... presidential campaign debate possibly? where trump's answer to "but you did tax crimes" was "yeah well you didn't stop me". that's what this sounds like: "it's somebody else's job to stop us, not ours"

Thats because they do not believe the doom machine is real and want to engage in regulatory capture of the tech

I think a missing part from the conversation is in how many scenarios an AI that goes rogue and might kill us all gets stopped by another AI. If they believe everyone is developing AI recklessly, but their AI is significantly more likely to be the solution, then it's rational to continue?

It's like if the backstory of Horizon: Zero Dawn were both real and also the players involved were INFINITELY more stupid than Faro was.

déluge. Can't blame autocorrect for this one. Anyway my host here drove me past a palace she described as "a little Versailles" the other day, and I said, "if _THIS_ is 'un peau Versailles' I understand much better now why you chopped off these people's heads"

I'm going to be stuck with the mental image of skin versailles all day (you meant "un petit versailles"; "un peu" is more like "a little bit of")

Another thing I didn't know: The French government nationalized all church lands and buildings, so owns e.g. Notre Dame de Paris (the building). The church still owns the contents of the buildings, and there's a complicated church-and-state-separation thing going on about who controls what

It’s the same thing as with Trump social media being batshit, average people aren’t online enough to see it and it’s too crazy for media to report, but it reaches its intended audience of conspiracy-pilled meme junkies just fine

This is how you control narratives, by making them sensational, dramatic, and overwhelming, stringing along audiences hoping for a big climax The real solution, regulatory structure, is so boring, so anti-climatic, you don’t even have to worry about it actually happening

not remotely an endorsement of such behavior, but if I were in these guys' positions I would probably not talk in such a way that encourages unwell or frightened to regard me as threatening.

like if you think something has a >10% chance of killing everyone and you continue to work on it, what precisely is someone supposed to think of you? And if they really believe you - what actions might they take to reduce that 10% risk?

This is all part of their comic book fantasy world lens. “So yeah the evil scientist was the bad guy, but he was a genius. Maybe a mad genius, sure - but the superhero was really just some muscle bound jock Chad with a big chin who got girls!” At least AI bros know who they are, I guess.

The disconnect is that the supposed speed of development is a key selling point for AI boosters, so claiming that it's advancing so fast that it could end human civilization is a "line go up" strategy, it's a good indicator for them that it might do that

Also have these people seen chinese propaganda efforts? They're not that good at it, or at least don't do that style of propping up local grassroots orgs. What they're imagining is much closer to a Russian OP. But I don't think any of them actually believe it, they couldn't be that deluded??

Right now it feels like there’s a whole group of people open source building a nuclear weapon that if successful will be powerful enough to ignite the earth’s air and end all life,… and the response is ‘meh,… let’s keep building it’ bsky.app/profile/fain...

Faine Greenwood@faineg.com

"surely it is insidious Chinese propaganda that's making normal people hate and fear us, instead of how we say stuff like this on main all the time" - the big American genAI companies

i mean "the entire world should probably come together to figure out this big stupid thing that is killing us all" is fairly basic humanistic crisis management. the fact that they STARTED this avalanche and are just seeing it is a problem NOW means we need to make sure they get it by it first

ai sickos are just, yknow, dumb idiot failhuman sickos who care more about the metrics and signifiers that they have been fed by global hegemony for the last, mmm, like 100, 80 years at absolute minimum, than knowing what the fuck what they're doing actually means for themselves and the rest of us