Stochastic parrot
In machine learning, the term stochastic parrot is a metaphor, introduced by Emily M. Bender and colleagues in a 2021 paper, that frames large language models as systems that statistically mimic text without real understanding. The term carries a negative connotation.
Stochastic parrot - Wikipedia Jump to content From Wikipedia, the free encyclopedia Term used in machine learning In machine learning , the term stochastic parrot is a metaphor that frames large language models as systems that statistically mimic text without real understanding. The word "stochastic" – from the ancient Greek " στοχαστικός " ( stokhastikos , ' based on guesswork ' ) – is a term from probability theory meaning "randomly determined". [ 1 ] The word "parrot" refers to parrots ' ability to mimic human speech . [ 1 ] The term was introdu
saved by
related reading
- When "technically true" becomes "actually misleading"theargumentmag.com
- Large Language Model: world models or surface statistics?thegradient.pub
- Polly Wants a Better Argumentverysane.ai
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- On the Biology of a Large Language Modeltransformer-circuits.pub
- Can Language Models Be Too Big? | TWIML - The Voice of Machine Learning & AItwimlai.com
- ChatGPT Is Nothing Like a Human, Says Linguist Emily Bendernymag.com
- [2101.10098] The Slodderwetenschap (Sloppy Science) of Stochastic Parrots -- A Plea for Science to NOT take the Route Advocated by Gebru and Benderarxiv.org
- Surfacing Pathological Behaviors in Language Models | Transluce AItransluce.org
- Against LLM Reductionism — LessWronglesswrong.com
- Mechanistically Eliciting Latent Behaviors in Language Models — AI Alignment Forumalignmentforum.org
- Large Language Diffusion Modelsarxiv.org