gpt-2/model_card.md at master · openai/gpt-2 · GitHub
Inspired by Model Cards for Model Reporting (Mitchell et al.), we’re providing some accompanying information about the GPT-2 family of models we're releasing. This model was developed by researchers at OpenAI to help us understand how the capabilities of language model capabilities scale as a function of the size of the models (by parameter count) combined with very large internet-scale datasets (WebText). February 2019, trained on data that cuts off at the end of 2017. Language model 1.5 billion parameters: the fourth and largest GPT-2 version. We have also released 124 million, 355 million, and 774 million parameter models. Blog post and paper Please use this Google Form The primary intended users of these models are AI researchers and practitioners. We primarily imagine these language models will be used by researchers to better understand the behaviors, capabilities, biases, and constraints of large-scale generative language models. Here are some secondary use cases we believe are
GPT-2 model card Last updated: November 2019 Inspired by Model Cards for Model Reporting (Mitchell et al.) , we’re providing some accompanying information about the GPT-2 family of models we're releasing. Model Details. This model was developed by researchers at OpenAI to help us understand how the capabilities of language model capabilities scale as a function of the size of the models (by parameter count) combined with very large internet-scale datasets (WebText). Model date February 2019, trained on data that cuts off at the end of 2017. Model type Language model Model version 1.5 billion p
Explore this link on the map →related reading
- gpt-4.pdfcdn.openai.com
- GPT-4openai.com
- GPT-3 - Wikipediaen.wikipedia.org
- OpenAI’s GPT-2: the model, the hype, and the controversy - KDnuggetskdnuggets.com
- Gemma 2: Improving Open Language Models at a Practical Sizearxiv.org
- gpt-4-system-card.pdfcdn.openai.com
- LLM Architecture Gallery | Sebastian Raschka, PhDsebastianraschka.com
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- GPT-2 — Mysterious Universe. I work for a company called Sandpit in… | by Rachel Perks | Sandpit | Mediummedium.com
- 2405.01470arxiv.org
- Making Large Language Models work for yousimonwillison.net
- Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com