GPT-3
Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. It is the third-generation language prediction model in the GPT-n series (and the successor to GPT-2) created by OpenAI, a San Francisco-based artificial intelligence research laboratory. GPT-3's full version has a capacity of 175 billion machine learning parameters. GPT-3, which was introduced in May 2020, and was in beta testing as of July 2020, is part of a trend in natural language processing (NLP) systems of pre-trained language representations. Before the release of GPT-3, the largest language model was Microsoft's Turing NLG, introduced in February 2020, with a capacity of 17 billion parameters or less than a tenth of GPT-3s.The quality of the text generated by GPT-3 is so high that it is difficult to distinguish from that written by a human, which has both benefits and risks. Thirty-one OpenAI researchers and engineers presented the original May 28, 2020 paper introducing GPT-3. In their paper, they warned of GPT-3's potential dangers and called for research to mitigate risk. David Chalmers, an Australian philosopher, described GPT-3 as "one of the most interesting and important AI systems ever produced."Microsoft announced on September 22, 2020 that it had licensed "exclusive" use of GPT-3; others can still use the public API to receive output, but only Microsoft has control of the source code.
GPT-3 - Wikipedia Jump to content From Wikipedia, the free encyclopedia 2020 text-generating language model See also: Generative pre-trained transformer § Foundation models Generative Pre-trained Transformer 3 (GPT-3) Original author OpenAI [ 1 ] Release May 29, 2020 (publication); June 11, 2020 (OA API beta) Predecessor GPT-2 Successor GPT-3.5 GPT-4 Type Large language model Generative pre-trained transformer Foundation model License Proprietary Website openai .com /blog /openai-api Repository github .com /openai /gpt-3 Part of a series on OpenAI Products ChatGPT Search Deep Rese
Explore this link on the map →saved by
related reading
- GPT-4openai.com
- gpt-4.pdfcdn.openai.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- Simulators — LessWronglesswrong.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Giving GPT-3 a Turing Testlacker.io
- GPT-3 Creative Fiction · Gwern.netgwern.net
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- Making Large Language Models work for yousimonwillison.net
- GitHub Copilot Can Do More Than Just Codedagshub.com
- Generative AI: A New Generation of AI - by Josh Houjoshhou.substack.com