3Blue1Brown - Large Language Models explained briefly
Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of what word comes next. You could then finish the script by feeding in what you have to the machine, seeing what it would predict to start the AI's answer, and then repeating this over and over with a growing script completing the dialogue. The machine, after being fed Can you explain...a semiconductor device..., predicts the word used. The machine, after being fed Can you explain...semiconductor device used..., predicts the word to. When you interact with a chatbot, this is exactly what's happening. A large language model(LLM) is a sophisticated mathematical function that predicts what word comes next for any piece of text. Instead of predicting one word with certainty, though, what it doe
Large Language Models explained briefly | 3Blue1Brown Neural Networks L a r g e L a n g u a g e M o d e l s e x p l a i n e d b r i e f l y A lightweight intro to LLMs, laying the foundation for the following lessons. Nov 20, 2024 Lesson by Grant Sanderson Text adaptation by Justin Sun Source Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of wha
related reading
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- GenAI Handbookgenai-handbook.github.io
- How LLMs Work, Explained Without Math - miguelgrinberg.comblog.miguelgrinberg.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Large Language Model: world models or surface statistics?thegradient.pub
- Productizing Large Language Modelsblog.replit.com
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
- A History of Large Language Modelsgregorygundersen.com
- “Next-token predictor” is the wrong mental model for LLMsgmcgoldr.github.io
- How LLMs Actually Work | 0xkato0xkato.xyz
- Introduction to Large Language Models | Machine Learning | Google for Developersdevelopers.google.com