Post

would love to hear even a single actual argument about how AI "changes the nature of humanity" not based in fanciful speculation

Demonstrating reasoning and language capabilities in computers alters our understanding of self, even if we don't particularly like the alteration

I disagree with your fundamental premise. The fact that a machine trained on billions of real conversations online can mimic reasoning does nothing to alter my understanding of self. And you haven't given any argument as to why it should.

This is the crux of the debate, right? Whether it's doing mimicry or reasoning. I struggle to see how you could view it as purely mimicry. It has to tie together multiple novel thoughts in a logical construction to create its responses.

Because the machine hallucinates, it's not actually reasoning, it's stitching stuff together that looks plausible from what it has been fed.