Post

COMMUNITY NOTE: today's models are all reasoning models. This paper's dramatic results, like SynthID came from non-reasoning variants Almost all uncertainty is hashed out during reasoning (where watermarking doesn't happen). The watermarking in the final answer only pivots between syntax & phrasing

This post is unavailable.

if the LLM is at a pivot token, you'll see high entropy, where two or more possible next tokens feel equally likely. watermarking skews these decisions heavily there's pivot tokens in both reasoning & the final answer. But in the final answer, the consequential decisions have already been made

so, another way to say it — yes, watermarking "damages" the text. But only an increasingly small portion even the paper being cited demonstrates this!

It's all foreign muck! That buffalo mozzarella made from African cow's milk. And that 'Basil', native to tropical regions from Central Africa to Southeast Asia. ;)