rasbt/LLMs-from-scratch: Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
github.com · 1,428 words · saved by 5 readers
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Build a Large Language Model (From Scratch) This repository contains the code for developing, pretraining, and finetuning a GPT-like LLM and is the official code repository for the book Build a Large Language Model (From Scratch). In Build a Large Language Model (From Scratch), you'll learn and understand how large language models (LLMs) work from the inside out by coding them from the ground up, step by step. In this book, I'll guide you through creating your own LLM, explaining each stage with clear text, diagrams, and examples. The method described in this book for training and…
saved by
related reading
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- GenAI Handbookgenai-handbook.github.io
- Writing an LLM from scratch, part 1 :: Giles' bloggilesthomas.com
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- microgptkarpathy.github.io
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Deep Dive into LLMs like ChatGPTyoutube.com
- GitHub - karpathy/nanochat: The best ChatGPT that $100 can buy.github.com
- GitHub - karpathy/autoresearch: AI agents running research on single-GPU nanochat training automaticallygithub.com
- AI Engineering from Scratchaiengineeringfromscratch.com