3Blue1Brown - Large Language Models explained briefly
Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of what word comes next. You could then finish the script by feeding in what you have to the machine, seeing what it would predict to start the AI's answer, and then repeating this over and over with a growing script completing the dialogue. The machine, after being fed Can you explain...a semiconductor device..., predicts the word used. The machine, after being fed Can you explain...semiconductor device used..., predicts the word to. When you interact with a chatbot, this is exactly what's happening. A large language model(LLM) is a sophisticated mathematical function that predicts what word comes next for any piece of text. Instead of predicting one word with certainty, though, what it doe
Large Language Models explained briefly | 3Blue1Brown Neural Networks L a r g e L a n g u a g e M o d e l s e x p l a i n e d b r i e f l y A lightweight intro to LLMs, laying the foundation for the following lessons. Nov 20, 2024 Lesson by Grant Sanderson Text adaptation by Justin Sun Source Imagine you happen across a short movie script that describes a scene between a person and their AI assistant. The script has what the person asks the AI, but the AI's response has been torn off. Suppose you also have this powerful machine that can take in any text and provide a sensible prediction of wha
related reading
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- How LLMs Work, Explained Without Math - miguelgrinberg.comblog.miguelgrinberg.com
- Introduction to Large Language Models | Machine Learning | Google for Developersdevelopers.google.com
- A simple technical explanation of RLH(AI)F | Kairos.fmkairos.fm
- Deep Dive into LLMs like ChatGPTyoutube.com
- How LLM Inference Worksarpitbhayani.me
- A History of Large Language Modelsgregorygundersen.com
- Large Language Model: world models or surface statistics?thegradient.pub
- How LLMs Actually Work | 0xkato0xkato.xyz
- Understanding Attention in LLMs | Bartosz Milewski's Programming Cafebartoszmilewski.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com