Post

The argument about watermarking doesn’t make sense. LLM’s already don’t select the “best” or “most precise” next token by design! The token is sampled randomly from a distribution. This simply changes the distribution, but it’s misguided to believe that there exists an “optimal” distribution.

Well ackchually you can play with temperature, lower temperature = actually pick the highest probability token virtually every time. But there's a reason LLMs don't run with temperature 0. A writer would surely hate the output of such an LLM.

So you agree they play with temperature to increase the overall quality of the output?

0 reposts0 likes

Also, you seem to think that watermarking would always replace a more likely token with a less likely one. Not necessarily. Sometimes it would have picked the less likely token, but the watermark forced a more likely one. It's not like it will suddenly start calling Brazil the capital of France.