Post

Demonstrating reasoning and language capabilities in computers alters our understanding of self, even if we don't particularly like the alteration

This is the crux of the debate, right? Whether it's doing mimicry or reasoning. I struggle to see how you could view it as purely mimicry. It has to tie together multiple novel thoughts in a logical construction to create its responses.

This perhaps says something about the logic inherent in language, or in the surprising observation that compression has an equivalence to intelligence due to the nature of what prediction means, but here we are: the LLMs work through novel questions and scenarios regularly

next word prediction leading to intelligence is nicely described by the carl sagan quote "if you want to bake an apple pie from scratch u must first invent the universe" it needs to simulate a whole world to think of what would happen next, given its context

I guess...... yeah, the navigation through the embedding space could be argued to reflect the full mind/world state even when it doesn't activate every possible neuron

0 reposts7 likes

Language is the interface, and as such there is interop. If the what is reason and the claim is that "reasoning" must use the same method to arrive at said answer, that's fine, but that's almost an ancient question, never to be solved.