Andrej Karpathy on X: "With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates: - Input & Output across modalities (text, audio, vision) - Code interpreter, ability to write & run… https://t.co/2HsyslOG2F" / X
With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates: - Input & Output across modalities (text, audio, vision) - Code interpreter, ability to write & run…
Andrej Karpathy @karpathy With many 🧩 dropping recently, a more complete picture is emerging of LLMs not as a chatbot, but the kernel process of a new Operating System. E.g. today it orchestrates: - Input & Output across modalities (text, audio, vision) - Code interpreter, ability to write & run programs - Browser / internet access - Embeddings database for files and internal memory storage & retrieval A lot of computing concepts carry over. Currently we have single-threaded execution running at ~10Hz (tok/s) and enjoy looking at the assembly-level execution traces stream by. Concepts from co
related reading
- Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / Xx.com
- 2025 LLM Year in Review – karpathykarpathy.bearblog.dev
- Malleable software in the age of LLMsgeoffreylitt.com
- Deep Dive into LLMs like ChatGPTyoutube.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- At the Intersection of LLMs and Kernels - Research Roundupcharlesfrye.github.io
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
- Can LLMs Be Computers?percepta.ai
- Things we learned about LLMs in 2024simonwillison.net
- Scaling: The State of Play in AIoneusefulthing.org
- Extensible Software in the age of LLMs | Jeremy Morrelljeremymorrell.dev