Stochastic parrot
In machine learning, the term stochastic parrot is a metaphor, introduced by Emily M. Bender and colleagues in a 2021 paper, that frames large language models as systems that statistically mimic text without real understanding. The term carries a negative connotation.
Stochastic parrot - Wikipedia Jump to content From Wikipedia, the free encyclopedia Term used in machine learning In machine learning , the term stochastic parrot is a metaphor that frames large language models as systems that statistically mimic text without real understanding. The word "stochastic" – from the ancient Greek " στοχαστικός " ( stokhastikos , ' based on guesswork ' ) – is a term from probability theory meaning "randomly determined". [ 1 ] The word "parrot" refers to parrots ' ability to mimic human speech . [ 1 ] The term was introdu
Explore this link on the map →saved by
related reading
- ChatGPT Is Nothing Like a Human, Says Linguist Emily Bendernymag.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- The Waluigi Effect (mega-post) — LessWronglesswrong.com
- [2101.10098] The Slodderwetenschap (Sloppy Science) of Stochastic Parrots -- A Plea for Science to NOT take the Route Advocated by Gebru and Benderarxiv.org
- Can Language Models Be Too Big? | TWIML - The Voice of Machine Learning & AItwimlai.com
- Shtetl-Optimized >> Blog Archive >> The False Promise of Chomskyismscottaaronson.blog
- GenAI Handbookgenai-handbook.github.io
- The Yale Review | Melanie Mitchell: The Dangerous Unknowns at the…yalereview.org
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- Against LLM Reductionism — LessWronglesswrong.com
- Large Language Model: world models or surface statistics?thegradient.pub