Post

LLMs only become functional after training on an enormous corpus of text, whereas human language capabilities develop with far less of such information- the term IIRC is "poverty of the stimulus". So we know that the process by which LLMs produce output when prompted is *not* the process humans use.

i think i would agree with your conclusion there! though I am not a Chomsky fan and feel skeptical about poverty of the stimulus in general.

Yep, it's an enormous oversimplification, actively detrimental to people's understanding of the tech, and contributes to the alarming growth of science denialism. Deep learning neural network models do, to a *very* limited extent, work like a human brain, but definitely NOT the other way around.

I wouldn’t say β€œwork like a brain”, it’s more a model that simulates similar outputs for the same inputs (it’s not really based on actual biological neurons, just a more or less convenient representation of what they _might_ do).

Yep, that's a better description. We call them "models" for a good reason, right? They're only meant to simulate (and due to the numerous ways in which they differ from the real thing, can never fully replicate) neural pathways. Wake me up when they start simulating the effects of neurotransmitters.