Language models can only write poetry

But only a person can write a poem

Language models can only write poetry This is a revised and condensed version of “(Notes toward a theory of) Language models and poetics,” delivered as the Vector Institute ARTificial Intelligence Distinguished Lecture in August 2020 . Cold bones In 2019, Gwern Branwen—a well-known machine learning researcher—posted the results of several experiments in fine-tuning a large pre-trained language model on a corpus of poetry. The language model in question was OpenAI’s GPT-2. Here are some of the results: There comes a murmur low and sweet As of far-off streams in a dream, Or a murmur of many bird

related reading

• The Human Skill That Eludes AI - The Atlantictheatlantic.com
• Why A.I. Isn’t Going to Make Art | The New Yorkernewyorker.com
• LLM poetry and the "greatness" question - by Hollis Robbinshollisrobbinsanecdotal.substack.com
• Language Modelinglena-voita.github.io
• trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
• If you let AI do your writing, I will come to your house and kill yousamkriss.substack.com
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• The Dark Forest and Generative AImaggieappleton.com
• Making Large Language Models work for yousimonwillison.net
• ChatGPT Is Dumber Than You Think - The Atlantictheatlantic.com
• Language Modeling Without Neural Networksnathan.rs
• trees are harlequins, words are harlequins - hydrogen jukeboxes: on the crammed poetics of...nostalgebraist.tumblr.com