Deep Dive into LLMs like ChatGPT - YouTube
youtube.com · 11,267 words · saved by 5 readers
Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.
This is a general audience deep dive into the Large Language Model (LLM) AI technology that powers ChatGPT and related products. It is covers the full training stack of how the models are developed, along with mental models of how to think about their "psychology", and how to get the best use them in practical applications. I have one "Intro to LLMs" video already from ~year ago, but that is just a re-recording of a random talk, so I wanted to loop around and do a lot more comprehensive version. Instructor Andrej was a founding member at OpenAI (2015) and then Sr. Director of AI at Tesla…
saved by
related reading
- Let's reproduce GPT-2 (124M)youtube.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Neural Networks: Zero To Herokarpathy.ai
- Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- GenAI Handbookgenai-handbook.github.io
- How might LLMs store facts | Deep Learning Chapter 7youtube.com
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- microgptkarpathy.github.io