You can’t imitation-learn how to continual-learn — LessWrong
In this post, I’m trying to put forward a narrow, pedagogical point, one that comes up mainly when I’m arguing in favor of LLMs having limitations that human learning does not. …
x You can’t imitation-learn how to continual-learn — LessWrong AI Curated 2026 Top Fifty: 9 % 206 You can’t imitation-learn how to continual-learn by Steven Byrnes 16th Mar 2026 7 min read 54 206 In this post, I’m trying to put forward a narrow, pedagogical point, one that comes up mainly when I’m arguing in favor of LLMs having limitations that human learning does not. (E.g. here , here , here .) See the bottom of the post for a list of subtexts that you should NOT read into this post, including “…therefore LLMs are dumb”, or “…therefore LLMs can’t possibly scale to superintelligence”. Some i
Explore this link on the map →related reading
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- NL.pdfabehrouz.github.io
- GenAI Handbookgenai-handbook.github.io
- The Continual Learning Problemjessylin.com
- Continual Learning in Token Space | Lettaletta.com
- Animals vs Ghosts – karpathykarpathy.bearblog.dev
- What's so hard about continuous learning?seangoedecke.com
- What are the real problems of continual learning?infinitefaculty.substack.com
- Reimagining LLM Memory: Using Context as Training Data Unlocks Models That Learn at Test-Time | NVIDIA Technical Blogdeveloper.nvidia.com
- How does in-context learning work? A framework for understanding the differences from traditional supervised learning | SAIL Blogai.stanford.edu
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com