How LLMs Work, Explained Without Math - miguelgrinberg.com
I'm sure you agree that it has become impossible to ignore Generative AI (GenAI), as we are constantly bombarded with mainstream news about Large Language Models (LLMs). Very likely you have tried ChatGPT, maybe even keep it open all the time as an assistant. A basic question I think a lot of people have about the GenAI revolution is where does the apparent intelligence these models have come from. In this article, I'm going to attempt to explain in simple terms and without using advanced math how generative text models work, to help you think about them as computer algorithms and not as magic. I'll begin by clearing a big misunderstanding people have regarding how Large Language Models work. The assumption that most people make is that these models can answer questions or chat with you, but in reality all they can do is take some text you provide as input and guess what the next word (or more accurately, the next token) is going to be. Let's start to unravel the mystery of LLMs from t
How LLMs Work, Explained Without Math - miguelgrinberg.com How LLMs Work, Explained Without Math Posted by on 2024-05-05T14:02:52Z under I'm sure you agree that it has become impossible to ignore Generative AI (GenAI), as we are constantly bombarded with mainstream news about Large Language Models (LLMs). Very likely you have tried ChatGPT , maybe even keep it open all the time as an assistant. A basic question I think a lot of people have about the GenAI revolution is where does the apparent intelligence these models have come from. In this article, I'm going to attempt to explain in simple t
Explore this link on the map →saved by
related reading
- GenAI Handbookgenai-handbook.github.io
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- LLM Daydreaming · Gwern.netgwern.net
- Large Language Models explained briefly | 3Blue1Brown3blue1brown.com
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- How LLMs Actually Work | 0xkato0xkato.xyz
- Against LLM Reductionism — LessWronglesswrong.com
- Large Language Model: world models or surface statistics?thegradient.pub
- Catching up on the weird world of LLMssimonwillison.net
- Against LLM Reductionismerichgrunewald.com
- LLMs Are Not All You Need | Pineconepinecone.io
- Best explanations of how LLMs work | Roman Vorushinvorushin.github.io