Why do AI models use so many em-dashes?
If you asked most people to name a defining feature of AI-generated writing, they’d probably say the em-dash — like this. Language models use em-dashes so much that real humans who like em-dashes have stopped using them out of fear of being confused with AI. It’s also surprisingly hard to prompt models to avoid em-dashes: take this thread from the OpenAI forums where users share their unsuccessful attempts. Given all that, it’s kind of weird that we don’t really know why language models use the em-dash so much. One common explanation is that normal English text contains a lot of em-dashes, so it’s just learned behavior from the training data. I find this fairly unconvincing, for the reason that everyone thinks AI uses a lot of em-dashes. If em-dashes were as common in AI prose as human prose, they would be as unremarkable as the use of other punctuation marks. Another explanation I’m not convinced by is that AI models like em-dashes because they’re so versatile. When the model is tryin
If you asked most people to name a defining feature of AI-generated writing, they’d probably say the em-dash — like this. Language models use em-dashes so much that real humans who like em-dashes have stopped using them out of fear of being confused with AI. It’s also surprisingly hard to prompt models to avoid em-dashes: take this thread from the OpenAI forums where users share their unsuccessful attempts. Given all that, it’s kind of weird that we don’t really know why language models use the em-dash so much . Explanations I don’t find convincing One common explanation is that normal English
related reading
- AI Can Pry the EM Dash Out of My Cold, Dead Handsneboagency.com
- Em dashes are fucking amazingpsychotechnology.substack.com
- How AI-generated prose diverges from human writing and why it matters | Reuters Institute for the Study of Journalismreutersinstitute.politics.ox.ac.uk
- Why You Should Almost Never Use AI to Write Anything Substantiveerichgrunewald.com
- If you let AI do your writing, I will come to your house and kill yousamkriss.substack.com
- The Human Skill That Eludes AI - The Atlantictheatlantic.com
- Simulated Users & Sad LLMs1a3orn.com
- Don't Let LLMs Write For You — LessWronglesswrong.com
- llm assistant personas seem increasingly incoherent (some subjective observations) — LessWronglesswrong.com
- Self-Fulfilling Misalignment Data Might Be Poisoning Our AI Modelsturntrout.com
- should we use AI to write?velvetnoise.substack.com
- 13 Signs You Used ChatGPT To Write Thatseanjkernan.substack.com