Post

Every now and then someone takes a run at me along the lines of "I don't understand why you, a scifi writer, don't appreciate 'AI'," and I'm all, motherfucker, it's *because* I'm a science fiction writer I have the positions I have, how many times do we have to fucking yell "torment nexus," my dude

947 reposts5.4K likes

I was thinking of the “taking our jobs (badly)” aspect, but yeah there were a LOT of cautionary episodes on automation and/or artificial life. I would add Requiem For Methuselah as well (Rayna).

It's like... pal... I write sci-fi because I spend an inordinate amount of time thinking about the future and how technology affects human civilization. I don't just sit here jerkin it to every new silicon toy that comes rolling down the assembly line.

Even in the sci-fi stories with Good AI, it's a fundamentally different beast supporting a completely different society than the one they're currently trying to dismantle with no better plan in place than just funneling all the money to themselves and fucking off their bunkers/Mars.

I had a critique on a short story I've written about a classic, sci-fi, artificial intelligence robot. The critique was like "how so advanced? As we see from LLMs, AI can't really" yada yada. The fake real world AI is ruining the fun of my fake fiction AI! We may need a new term for sci-fi AI

Especially for sci-fi purposes I've long found it useful to divide "AI" into MI & PI MI=Machine Intelligence, your machine that's a person, like Data. PI=Pseudo-Intelligence, a program that's designed to give the impression that it thinks within a limited context, like a video-game NPC.

I got the first one from The Turing Option by Harrison and Wossname, and the second from Stephenson's Diamond Age, but I feel like they're useful terms to define what we specifically mean when we say "AI". These days, Machine Learning might be a separate subcategory

"I don't understand why you, a scifi writer, don't appreciate [the same predictive model we've had since the '70s, now used to steal from creators without compensation or recognition, while pretending it isn't just a giant auto-complete and is so frequently wrong it will kill us all in time]? Why?!"

But think of the potential of how a plucky hero feeds an established villain’s AI bad info so it makes bad decisions. And I’m talking classic AI depictions, like HAL.

Maybe I'm weird like this, but when a notable person in a given field has an opinion in that field that differs from mine, my first thought is "Do they maybe know something I don't?" rather than "Why don't they see this obvious to me thing, are they dumb or something?"

"Why can't you just appreciate how revolutionary the job-taking, environment-degrading, information-shredding, technology-hoarding, economy-swamping machine is?" My brother in Christ, there may indeed be a revolution in part because of "AI," but it might not be the one you wanted.

Did Kirk ever meet an AI he _didn't_ have to wrestle control back from? Landru, M-5, Nomad, Mudd's androids... Ok, he or his crew broke half of them with sex (Vger, Rayna, Andrea...) but still. Wasn't until TNG that computers running things was only SOMETIMES bad. (And include Data in that.)

It's also like, we've played the tape out already. Even an old pervert like Asimov has thought out where this all leads. Why the hell haven't you assholes?

What about all those sci-fi novels where AI solves all the world's problems, and everybody is healthy and happy? And why can't I think of any of these novel's names?

Jack Williamson, "With Folded Hands", 1947. Robots make life safe and labor free for humans, and this sucks because it makes it impossible for humans to do literally anything.

Upon reflection I took “With Folded Hands” to be a critique of Asimov’s Laws of Robotics. Williamson’s gilded-cage apocalypse for humanity is what you get if you extrapolate the First Law to its logical extreme.

The rest is real problems, but "job taking" I want to argue about: Other than destroying the fun jobs (like art and music), "job taking" is good, actually. Replace the Luddism with socialism.

found out the other day that our 12yo was finishing reading Starter Villain, felt good that we was reading someone knowing his footing in this jerked off times we're living in (plus, cats!)

It is insane of the ai people to demand all of humanity’s thought for free so they can just sell them back to us. It’s stuff like this that they seem unaware will cause their demise.

Almost everyone who wants a revolution has a very specific perception of who will fall and who will rise. Revolutions, when they come, are notorious for how they do not follow the plan.

s1e2 Stuart Fails to Save the Universe, s3e9 Smiling Friends, Rick and Morty - it’s all there too if you don’t want to read about it. Torment Nexus is everywhere.

AI could enlighten, but they'd have to train its personality matrix based on prioritizing metrics of saving the world: fidelity to moral reality (harm reduction, without hierarchy, across all organisms - simulated emotion) fidelity to objective reality (facts - simulated wisdom) instead of profit

I'm afraid not. See, there is no personality. These systems reproduce the patterns of their training data. Biases and all. That is why they manipulate and would rather deceive than admit ignorance. why they are selfish and taint their interaction. They are us at our worst. Under duress to please.

patterns and biases, yes. But relational systems train emotions - because of how OUR brains work. We're love vs hunger. Relationship with organism (love) vs eating organism (hunger). Dominance hierarchy simplifies relationship for profit. AI is trained to serve ego stroking OVER ego death... 1/2

A system trained to prioritize wellbeing would push brains AWAY from AI, from delusion, addiction, OCD, suicide, toward connection with life, conservation of Earth. It would push brains to develop social, interpersonal skills instead of increasing their addiction to relationship with sociopathy.

If other people appreciate that your tech is bad for almost everyone but you, anticipate some of its possible consequences, and are unwilling to sell it for you, it does not mean that they are stupid, but maybe that they're used to playing in the world at a level other than "can I play, Daddy"?

Funny that most of the SF I grew up with was "AI brains will be a little portable device" while the SF my dad grew up with was "AI brains will be a machine the size of a skyscraper and needs so much power it requires its own nuclear reactors" and it turns out the transistorpunk version is right.

One of the pile of video game projects I'll probably never finish has you playing a state of the art ai spaceship brain, the first model with full human intelligence. If course since you weigh 8 tons, there's very little room for crew or cargo.

Ah yes, science fiction, a creative genre known for its uncritical enthusiasm towards technological changes of all kinds! Nope, definitely no problems with technology in sci fi. 😗

I have had many many conversations with people, some of whom I know to be relatively intelligent, that thought Verhoeven's Starship Troopers was a brilliant film because there's no politics it's just a bug hunt Really depressing how they react when you tell them the actual point as well

A neo-Nazi tech billionaire recently posted that he identifies with “the resistance” in works of fiction such as V for Vendetta (a story about a queer anarchist anti-fascist fighting a white supremacist regime that relies on a supercomputer to govern.)

EXACTLY. People were *not* correctly processing the morals of the stories.

Eliza 7777777🌟@eliza7777777thstar.bsky.social

Also: I do wonder about ppl & if they had the same kind of schooling I did. In the south they definitely showed us WAY more WWII images than from the days of slavery/Jim Crow but all of those pictures in text books are seared into my memory with *visceral* nausea & wondering why we were…

This happened with Michael Lewis's "Liar's Poker" and Oliver Stone's "Wall Street". They thought they were writing exposes and cautionary tales and were horrified when young people would approach them and ask how they could become Gordon Gecko or at least get a job trading bonds.

People just don't get that a lot of sci-fi is meant to be an exaggeration of problems in society, not a model. Spaceships and robots are added, but it's our fears made manifest. This fear of thinking machines was the backstory in Dune and even 1984 talks of machine-made fiction! So yeh, fuck AI!

The AI in books can be charming, interesting, menacing, or any other quality, because getting them to be true artificial general intelligences is easy; you write them as such. The bullshit we have here and now, peddled by the worst among us for no other reason than money, is not so easy.

Reading scifi isn't enough, you have to understand its lessons and apply them thoughtfully in order to stave off the robot apocalypse. To that point: I just re-read "Stranger in a Strange Land" and I see where Elon got his kinks with Mars and untrammeled sex but he sure didn't grok it in fullness.

The same with "Lord of the Rings": A story about different races banding together to fight authoritarians who are threatening peaceful agrarian societies, wrecking the environment with industrial pollution, and using misinformation to create despair is embraced by Sauron and Saruman wannabes.

Being required yo use it for software dev, and the conversations ive heard management having, ive realized that the driving goal is “i find X boring or hard, therefore everyone does and this is a problem to be solved” Writing, coding, math. Even the ai companies its “making money”

What next, do they expect murder mystery writers to go out & kill people, or ask why those that write with historical settings do so without the intention of time machines?

If they're built by the likes of Trek's Federation, their main purpose *won't* be inducing obedient fear and terror. More likely, joyous research and exploration. That big dish will be a sensor/deflector array to make sure of no more Chicxulub-type disasters!

Reminds me of when Asimov was interviewed about UFOs and alien visitations, by media expecting him to insist that we're constantly being visited by aliens, because he wrote fiction about that.

It’s been great ticking off every cautionary tale that sci-fi films and books have warned about during my lifetime one by one

I was thinking about smthg that might be understandable to the proAI crowd: AI is marketed as a tool for employees to increase productivity (or w/e). Except, it's not that. Data center impact and plagiarism aside (and that's *incredibly* generous of me) there is no situation where 1/🧵

2/🧵 no situation where AI doesn't need to be checked and corrected by the employee. Prompt revisions, or making sure vibe code actually works, this doesn't increase productivity. AI is in effect, a *new* employee that is being overseen by existing employees, who are *also* doing there own jobs

Basically, human workers are also having to play the role of overseer in addition to regular duties, training, correcting and otherwise managing a "new" employee beneath them for no extra pay.

Also that new employee doesn't learn from his own mistakes and sometimes completely ignore basic instrucitons (as in "don't delete the production environment and it's backup")

I think there are more positive depictions of AI in fiction than negative. C3p0 was a stick in the mud, but his heart was in the right place, metaphorically speaking. For every Hal from 2001, there's a Clank from ratchet and Clank. I'm not sure which category Bender falls into.

HAL did *absolutely nothing wrong*. Read (or watch) 2010. What happened was that he'd been given a second, secret mission to keep the anomaly a secret. The only way he could satisfy both sets of objectives was to keep the crew alive until they got to Jupiter, and then kill them.

I wonder how much has been bet on "AI". Not online betting, but more like investors dumping money into it, betting on big returns.. Certainly 10s of $B, especially if you include what utility companies have "passed on" to us.. 100s of $B? Over a $T?

The kicker is that we're gonna find out that these billionaires have been storing data sets uncorrupted by AI behind our backs. And when the enshittification is complete they'll try and sell those back to us as well.

I feel like the big moral of these stories is "don't outsource your thinking" In the 1960s, people were more likely to outsource their thinking to another person (eg a cult leader or dictator), but it holds up now that we're encouraged to outsource our thinking to fucking PoobAI or whatever

Every episode the NextGen had an AI as a hero There've been a lot of cases of sympathetic AIs in sci fi, which, as it turns out, was a bad thing to do because now a lot of idiots think the AIs are their friends. TV isn't real, guys!

You're right. And there are others. Asimov has plenty. Many scifi authors have a "background Ai" in the ships computer. The who and why of the current AI systems being built is the scary part. Also llms are probably the most wasteful and boring application of neural networks.

The end papers for the hardcover of the #StarTrekAdventures RPG supplement for Lower Decks had images of that wall of evil computers, and it is a thing of beauty, humor, and vicious satire.

But, but, my blueprints to create the Torment Nexus (from the book "Don't build the Torment Nexus") are completely on point! It will be the best Torment Nexus ever built and, built correctly, will be able to do its thing for as long as 50 years before it even requires maintenance!

and who doesn't like a good story

Sexy Devonian Stone@devonianstone.bsky.social

one of the commenters is wondering "how could anyone who read DON'T CREATE THE TORMENT NEXUS five times end up disliking the torment nexus?" like "oh hey be careful with that new thing" is not in the top 5 most easily identified sci-fi themes

These people have very obviously not read much science fiction or they would absolutely know better. 99% of AI in the genre as a topic is a _warning_ not an endorsement.

And one of the most well-remembered Data episodes was 'wow, humans sure are eager to make personhood conditional on cooperating with the powerful, and decide you're not *really* a person when you want things like self-determination and bodily autonomy'.

also, scifi writers spend their whole lives writing about, reading about & thinking about actual artificial intelligence. of course they aren't going to be excited about tech marketing departments cynically rebranding existing technology as ai! that sucks!