GPT-1
Generative Pre-trained Transformer 1 (GPT-1) is OpenAI's first large language model (LLM) in its GPT series of models, developed following Google's invention of the transformer architecture in 2017. In June 2018, OpenAI released a paper titled "Improving Language Understanding by Generative Pre-Training", in which they introduced that initial model along with the term generative pre-trained transformer (GPT).
From Wikipedia, the free encyclopedia Generative Pre-trained Transformer 1 (GPT-1) Original authorOpenAI ReleaseJune 2018; 8 years ago SuccessorGPT-2 Type Large language model Generative pre-trained transformer LicenseMIT[1] Websiteopenai.com/blog/language-unsupervised/ Repository github.com/openai/finetune-transformer-lm Original GPT architecture Generative Pre-trained Transformer 1 (GPT-1) is OpenAI's first large language model (LLM) in its GPT series of models, developed following Google's invention of the transformer architecture in 2017.[2] In June 2018, OpenAI released a…
saved by
related reading
- Deep Dive into LLMs like ChatGPTyoutube.com
- Learning to reason with LLMs | OpenAIopenai.com
- GPT-4openai.com
- GPT-3 - Wikipediaen.wikipedia.org
- AI Timeline — Complete History of 194+ Large Language Modelsllm-timeline.com
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- gpt-4.pdfcdn.openai.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Nirmaan's AI Thesis — Nirmaanmirror.xyz
- Generalized Language Models | Lil'Loglilianweng.github.io