flâneur

Tenobrus on X: "for some reason people seem to have Anthropic Derangement Syndrome over a pretty straightforward combination of cryptographic primitives and LLM sampling techniques. so as someone who isn't an employee, let me try to explain what's going on with watermarking step by step. -" / X

x.com · 862 words · saved by 1 readers

for some reason people seem to have Anthropic Derangement Syndrome over a pretty straightforward combination of cryptographic primitives and LLM sampling techniques. so as someone who isn't an employee, let me try to explain what's going on with watermarking step by step. -

for some reason people seem to have Anthropic Derangement Syndrome over a pretty straightforward combination of cryptographic primitives and LLM sampling techniques. so as someone who isn't an employee, let me try to explain what's going on with watermarking step by step. - LLMs work by probabilistically autoregressively sampling tokens. meaning: at every token, the model weights don't output a single next token, but a probability distribution over *all possible tokens*, a bunch of little numbers that sum to 1 - the "temperature" sampling setting affects how this distribution is…

saved by

related reading