Post

I don't normally reply to Will's posts, because trying to convince him of anything is like trying to dig a hole in solid basalt with a plastic shovel, but he's wrong here. ChatGPT has all kinds of known harms, including encouraging people with latent mental instabilities to spiral into psychosis.

Will Stancil@whstancil.bsky.social

It is absolutely bananas that one of the most prominent anti-AI experts in America is talking like this. Talking to ChatGPT isn’t like doing heroin or downloading child porn. It will not hurt you and has no ethical valence. It will help you understand the nature of something that is now endemic.

2 reposts16 likes

The more someone uses chatbots the less I trust them to know the limits and capabilities of the software, because the ELIZA Effect is well documented. Blake Lemoine is a great cautionary tale here; he went down a rabbit hole because asked a chatbot if it was alive, and the chatbot said yes.

Preemptive warning: If you change the subject to anything else Stancil related I will add you to an appropriate blocklist. ("Stancil-obsessed," "Sealion," or both.) There's WAY too much discourse about the man already.

Now I'm always going to think of the YouTuber who told ChatGPT he was the smartest baby of 1996 and needed help rediscovering his genius, then just kept ramping things up to see how far it'd indulge that delusion.

It used to be only very rich people could afford a toady that would always agree with them and encourage their delusions; now, through the wonders of technology, anyone can.