Post

So imagine for a second that there is something it is like to be an LLM, generating tokens. Presumably, there is probably some perceptible change when you change the temperature? I think we've seen examples where the model definitely notices when you do something super strange to its sampling, too.

You're starting from a counterfactual here. There is nothing that it is like to be an LLM, scanning context and generating the most probable next tokens. There is no subjectivity there.

If you disagree with the starting point, then you have chosen to not participate in the discussion which starts in the other branch of the tree, which is your right, feel free to move on.

Sorry. I was attempting to open discussion about your assumption, which isn't harmless. Hazards of posting your assumptions in a public forum, I'm afraid.