What Is ChatGPT Doing … and Why Does It Work?—Stephen Wolfram Writings
Stephen Wolfram explores the broader picture of what's going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax.
Contents Top It's Just Adding One Word at a Time Where Do the Probabilities Come From? What Is a Model? Models for Human-Like Tasks Neural Nets Machine Learning, and the Training of Neural Nets The Practice and Lore of Neural Net Training "Surely a Network That's Big Enough Can Do Anything!" The Concept of Embeddings Inside ChatGPT The Training of ChatGPT Beyond Basic Training What Really Lets ChatGPT Work? Meaning Space and Semantic Laws of Motion Semantic Grammar and the Power of Computational Language So ... What Is ChatGPT Doing, and Why Does It Work? Thanks Additional Resources What Is Ch
Explore this link on the map →saved by
- Yung-Hsuan Yang
- Michelle Pan
- Ratan Kaliani
- Asma Lamgh
- Shivam Siddaiya
- Aryan Naik
- Adithya V
- Matviy Kotolyk
- jeremy h
- Nikki Guo
- Saeejith Nair
- Lundeen Cahilly
related reading
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- ChatGPT Is a Blurry JPEG of the Web | The New Yorkernewyorker.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Collections: On ChatGPT – A Collection of Unmitigated Pedantryacoup.blog
- The Scaling Hypothesis · Gwern.netgwern.net
- GPT-4openai.com
- How does ChatGPT work? As explained by the ChatGPT team. - The Pragmatic Engineerblog.pragmaticengineer.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- A Short History of Artificial Intelligenceevery.to
- microgptkarpathy.github.io