[2006.08381] DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning
Abstract:Expert problem-solving is driven by powerful languages for thinking about problems and their solutions. Acquiring expertise means learning these languages -- systems of concepts, alongside the skills to use them. We present DreamCoder, a system that learns to solve problems by writing programs. It builds expertise by creating programming languages for expressing domain concepts, together with neural networks to guide the search for programs within these languages. A ``wake-sleep'' learning algorithm alternately extends the language with new symbolic abstractions and trains the neural network on imagined and replayed problems. DreamCoder solves both classic inductive programming tasks and creative tasks such as drawing pictures and building scenes. It rediscovers the basics of modern functional programming, vector algebra and classical physics, including Newton's and Coulomb's laws. Concepts are built compositionally from those learned earlier, yielding multi-layered symbolic representations that are interpretable and transferrable to new tasks, while still growing scalably and flexibly with experience.
[2006.08381] DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Artificial Intelligence arXiv:2006.08381 (cs) [Submitted on 15 Jun 2020] Title: DreamCoder: Growing generalizable, interpretable knowledge with wake-sleep Bayesian program learning Authors: Kevin Ellis , Catherine Wong , Maxwell Nye , Mathias Sable-Meyer , Luc Cary , Lucas Morales , Luke Hewitt , Armando Solar-Lezama , Jos
Explore this link on the map →related reading
- DreamCoderarxiv.org
- Tracing the thoughts of a large language model \ Anthropicanthropic.com
- [2007.03132] Learning to learn generative programs with Memoised Wake-Sleeparxiv.org
- LLM Daydreaming · Gwern.netgwern.net
- Composer2.pdfcursor.com
- How Might We Learn?andymatuschak.org
- Learnable Programmingworrydream.com
- Deep learning as program synthesis — LessWronglesswrong.com
- Parsed | Custom, interpretable AI systems that continuously learnparsed.com
- Interpretability Dreamstransformer-circuits.pub
- Learning Beyond Gradientstrinkle23897.github.io
- Stream of Search (SoS): Learning to Search in Languagearxiv.org