Polly Wants a Better Argument - by SE Gyges
verysane.ai · 2,589 words · saved by 1 readers
The “Stochastic Parrot” Argument is Both Wrong and Actively Harmful
Perhaps the most influential single paper on the public perception of LLMs is On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?. It is, however, a bit of a mash-up, and credibly seems like it should have been at least two papers. One of those papers raises many valid concerns about the ethical implications and impacts of AI training and use. Another makes the claim in the title, that an LLM is a “stochastic parrot” operating “without any reference to meaning.” That core claim is either irrelevant or completely wrong in every detail, both in how it is commonly understood…
related reading
- Stochastic parrot - Wikipediaen.wikipedia.org
- How can LLM RL Work Despite Information-Theoretic Inefficiencyberen.io
- ChatGPT Is Nothing Like a Human, Says Linguist Emily Bendernymag.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Against LLM Reductionism — LessWronglesswrong.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- Large Language Model: world models or surface statistics?thegradient.pub
- Large Language Models Must Be Taught to Know What They Don't Knowarxiv.org
- Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
- Thoughts on AI in academiatheinfinitesimal.substack.com
- Language Models can Solve Computer Tasksarxiv.org
- Simulated Users & Sad LLMs1a3orn.com