3Blue1Brown - Large Language Models explained briefly
Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of what word comes next. You could then finish the script by feeding in what you have to the machine, seeing what it would predict to start the AI's answer, and then repeating this over and over with a growing script completing the dialogue. The machine, after being fed Can you explain...a semiconductor device..., predicts the word used. The machine, after being fed Can you explain...semiconductor device used..., predicts the word to. When you interact with a chatbot, this is exactly what's happening. A large language model(LLM) is a sophisticated mathematical function that predicts what word comes next for any piece of text. Instead of predicting one word with certainty, though, what it doe
Large Language Models explained briefly | 3Blue1Brown Neural Networks L a r g e L a n g u a g e M o d e l s e x p l a i n e d b r i e f l y A lightweight intro to LLMs, laying the foundation for the following lessons. Nov 20, 2024 Lesson by Grant Sanderson Text adaptation by Justin Sun Source Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of wha
Explore this link on the map →related reading
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- How LLMs Work, Explained Without Math - miguelgrinberg.comblog.miguelgrinberg.com
- GenAI Handbookgenai-handbook.github.io
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- Large Language Model: world models or surface statistics?thegradient.pub
- Natural Language Autoencoders Produce Unsupervised Explanations of LLM Activationstransformer-circuits.pub
- Making Large Language Models work for yousimonwillison.net
- How LLMs Actually Work | 0xkato0xkato.xyz
- Against LLM Reductionism — LessWronglesswrong.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- Introduction to Large Language Models | Machine Learning | Google for Developersdevelopers.google.com
- Language Modelinglena-voita.github.io