Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / X
To view keyboard shortcuts, press question mark View keyboard shortcuts Home Explore Notifications Chat Grok Premium Bookmarks Creator Studio Articles Profile More Post Lydia (in SF) @LydNot Post See new posts Conversation Andrej Karpathy @karpathy LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating knowledge (stored as markdown and images). The latest LLMs are quite good at it. So: Data ingest: I index source documents (articles, papers, repos, datasets, images, etc.) into a raw/ directory, then I use an LLM to incrementally "compile" a wiki, which is just a collection of .md files in a directory structure. The wiki includes summaries of all the data in raw/, backlinks, and then it categorizes data into concepts, writes articles for them, and links them all. To co
@karpathy: LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating knowledge (stored as markdown and images). The latest LLMs are quite good at it. So: Data ingest: I index source documents (articles, papers, repos, datasets, images, etc.) into a raw/ directory, then I use an LLM to incrementally "compile" a wiki, which is just a collection of .md files in a directory structur
saved by
related reading
- llm-wikigist.github.com
- GitHub - nashsu/llm_wiki: LLM Wiki is a cross-platform desktop application that turns your documents into an organized, interlinked knowledge base — automatically. Instead of traditional RAG (retrieve-and-answer from scratch every time), the LLM incrementally builds and maintains a persistent wiki from your sources。github.com
- Cerebras (@cerebras) on Xx.com
- A privacy-first, open-source knowledge baselogseq.com
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Customizing Karpathy's LLM wiki for fighting diseasekamens.com
- Claude Code整理Obsidian筆記！Karpathy公開LLM知識庫系統，貼一段指令就能建起來|數位時代 BusinessNextbnext.com.tw
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- Defileo🔮 on X: "Claude + Obsidian have to be illegal" / Xx.com
- How to Use LLMs Better - Learn How To Learnlearnhowtolearn.org
- LlamaIndex - by Kenn So - Generationalgenerational.pub
- Here’s how I use LLMs to help me write codesimonwillison.net