radford2018improving.pdf
cs.ubc.ca · 6,113 words · saved by 1 readers
N/A
Improving Language Understanding by Generative Pre-Training Alec Radford Karthik Narasimhan Tim Salimans Ilya Sutskever OpenAI OpenAI OpenAI OpenAI alec@openai.com karthikn@openai.com tim@openai.com ilyasu@openai.com Abstract Natural language understanding comprises a wide range of diverse tasks such as textual entailment, question answering, semantic…
saved by
related reading
- [2002.08909] REALM: Retrieval-Augmented Language Model Pre-Trainingarxiv.org
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- transformer_attention.pdfarxiv.org
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Language Models are Unsupervised Multitask Learnerscdn.openai.com
- 1810.04805arxiv.org
- Recent Advances in Language Model Fine-tuningruder.io
- [2305.18290] Direct Preference Optimization: Your Language Model is Secretly a Reward Modelarxiv.org
- Self-Adapting Language Modelsarxiv.org
- arxiv.org/pdf/1704.01444arxiv.org
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- Generalized Language Models | Lil'Loglilianweng.github.io