Post

Surprising: frontier models (Claude, ChatGPT, Deepseek V4) produce the most predictable text of any local AI model or human text I've ever tested. Not surprising: Finnegans Wake is off the charts, by far least predictable—Shannon & Lydia Liu proved right—and Hemingway the most predictable human.

Ryan Heuser@ryanheuser.com

Shannon measured the information rate of English at ~1 bit per character. According to a byte-level LLM measuring next-character predictability in LLM & human text (diaries, abstracts, dreams, fiction), aligned models produce sub-English information rates & LLM text is more predictable than humans'.

Frank Wunderlich-Pfeiffer

@frankwunderli13.bsky.social

29 May

Why would that be surprising? LLMs - AI slop - is best known for being drab and predictable and non-creative.

Ryan Heuser

@ryanheuser.com

29 May

What's surprising is that the giant trillion-parameter models are even more predictable than the tiny ones I can run on my own PC. That, plus the fact that 'aligned' or fine-tuned models are more predictable than their base model, suggests AI is optimized for predictability (a feature of slop?).

MrCheeze

@mrcheeze.github.io

Nah it's exactly what you'd expect. The most predictable answer to a question will of course be the correct one.

29/5/26, 4:36 pm0 reposts0 likes

No replies yet.