flâneur

String Seed of Thought: Prompting LLMs for Distribution-Faithful and Diverse Generation

pub.sakana.ai · 2,959 words · saved by 1 readers

SSoT: A simple prompting method that enables LLMs to generate distribution-faithful and diverse outputs by first generating a random string.

This page requires Javascript. Please enable it to view the website. tl;dr We introduce String Seed of Thought (SSoT), a simple prompting method that substantially improves LLMs' ability to follow probabilistic instructions and generate diverse outputs. SSoT instructs the LLM to first generate a random string, then manipulate it to derive the answer. The method requires no additional training or external tools, only a change to the prompt. SSoT instructs the LLM to (1) generate a random string to create a seed, then (2) manipulate it to generate an output. This simple two-stage prompt…

saved by

related reading