๐Ÿงต Thread (5 posts) 2026-08-25

I finally read and understood the SynthID paper and now I'm against LLM watermarking. It is only non-distortionary in a fairly weak way

To give a concrete example if an llm predicts the next token will be a or b with 50-50 probability and our watermarking function g gives 1 to a and 0 to b we'll sample a 75% of the time

I feel like the proponents have been eliding this point and implying it only changes the random seed. Which I would be okay with. But unfortunately doesn't let you predict if a given snippet was in an llm's output because it's not robust to crops/edits

I do concede that in practice humans can't distinguish the text so I'm not strongly against watermarking. But I don't think that's the standard by which this should be judged

I also think watermarking is not a very useful technology relative to pangram style detectors because there are a lot of llms including open ones