Language Models are Unsupervised Multitask Learners

N/A

Language Models are Unsupervised Multitask Learners Alec Radford * 1 Jeffrey Wu * 1 Rewon Child 1 David Luan 1 Dario Amodei ** 1 Ilya Sutskever ** 1 Abstract competent generalists. We would like to move towards more general systems which can perform many tasks – eventually Natural language processing tasks, such as ques- without the need to manually create and label a training tion answering, machine translation, reading com-…

related reading

• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• radford2018improving.pdfcs.ubc.ca
• Language Models can Solve Computer Tasksarxiv.org
• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• Self-Adapting Language Modelsarxiv.org
• Recent Advances in Language Model Fine-tuningruder.io
• 2005.14165arxiv.org
• A History of Large Language Modelsgregorygundersen.com
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• Generalized Language Models | Lil'Loglilianweng.github.io
• Large Language Diffusion Modelsarxiv.org
• Large Language Models Reading List | Sebastian Raschka, PhDsebastianraschka.com