Post

it makes me genuinely crazy watching tech journalists (and now Richard Dawkins) anthropomorphize software If our highest paid tech journalists are showing such a profound misunderstanding (or being actively misleading to get scoops and access), how well informed do we assume the public is?

Even calling LLM "AI" is accepting corporate advertising. Honest tech assessment would be pointing out that the companies pushing LLM don't even believe they are that useful. If they believed in their products, they would not need to make them addictive. So pernicious.

yeah I agree the intentional industry conflation with HAL 900 type awareness is definitely where the problem started

I agree it’s a problem, but it’s a symptom of the bigger problem that we are built to find people everywhere, and we don’t have good alternate words for what AI is doing that other people will understand. Looking at AI as modern fae really clarified things for me.

Consciousness may be the wrong framing entirely. Systems don’t need awareness to create significant problems. Optimization, autonomy, and integration into real-world systems are already enough to shift control in meaningful ways.

This article begs the question. What is the definition of consciousness? What does it mean to “have” it? Humans are also essentially a meat computer making probabilistic determinations, so what do we do that machines don’t? Describing how the sausage is made doesn’t tell us it’s not sausage.

I’m not sure any of us can have completely original thoughts either. You’ve been baking in culture and language for decades to bring you to this point. Not trying to prop up AI. I’m more undercutting our confidence about how different and unique human thinking is.

"you just don't understand, my sentient AI LLM tells me I am a special little boy, and very smart. Only a conscious being would tell me to pay $500/month to keep complimenting me for hours a day" -says someone lost in the AI sauce (Just to be clear, not me. #NeverAI)

Terrific piece. Blaming “Claude“ for deleting your codebase like blaming “rmdir” for deleting your directory. More generally: it’s not the robots that are the problem. It’s the people who own the robots who are the problem.

Not conscious, just disorienting

Derek Fox@partialobserver.bsky.social

Now that computer programs readily pass the Turing Test, we see that both Turing and Searle were correct: Searle in that programs can mimic human communication very well without anything like understanding, and Turing in that having programs do this is really f#*king disorienting.

No one is talking about the actual fix for this which is to legally prohibit these machines from expressing emotion or having personality of any kind. They should be like the computer on star trek that does not greet you, but does give you answers to your questions.

throwing my theory in the hat: this is partly because when confronted on a mistake, LLMs will take the blame for their mistake and apologize with a rationalization. Not because it actually did any of that, but because those are the words you use in that scenario.

but I guess, does convincingly emulating conscious thoughts have any practical differences from consciousness?

A guy teammate at my first job (Russia, '89, team of 10-15 mainframe programmers) coded a startup routine into his login that had his monitor saying, in a woman's voice, "Я готова, мой повелитель" ("I'm ready, my master").

You wrote a whole thing confidently claiming that AI is not actual consciousness without ever defining what consciousness is, which doesn't seem very productive

Prove that you are conscious. I know that sounds weird, but for all I know solipsism is real and you are just a philosophical zombie. Let's assume software does, at some point in the future, attains consciousness. It will literally be impossible to know.