radford2018improving.pdf
cs.ubc.ca · 6,113 words · saved by 1 readers
N/A
Improving Language Understanding by Generative Pre-Training Alec Radford Karthik Narasimhan Tim Salimans Ilya Sutskever OpenAI OpenAI OpenAI OpenAI alec@openai.com karthikn@openai.com tim@openai.com ilyasu@openai.com Abstract Natural language understanding comprises a wide range of diverse tasks such as textual entailment, question answering, semantic…
saved by
related reading
- [2002.08909] REALM: Retrieval-Augmented Language Model Pre-Trainingarxiv.org
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Generalized Language Models | Lil'Loglilianweng.github.io
- 1810.04805arxiv.org
- Recent Advances in Language Model Fine-tuningruder.io
- 1910.10683arxiv.org
- Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformerai.googleblog.com
- Unsupervised Elicitation of Language Modelsarxiv.org
- The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
- Transfer Learninglena-voita.github.io
- Language Models are Unsupervised Multitask Learnerscdn.openai.com
- 2005.14165arxiv.org