Challenges of governing continually learning AI – Runtime Verification
Earlier this month Google Research dropped a new paper titled “Nested Learning,” which introduces a new architecture that they are calling “a new ML paradigm for continual learning”. And it looks l…
Earlier this month Google Research dropped a new paper titled “Nested Learning,” which introduces a new architecture that they are calling “a new ML paradigm for continual learning”. And it looks like a real step towards new ML architectures that can learn and improve over time like humans do. What they’ve essentially done is trained modular neural networks where some of these modules act to immediately process the last tokens, some act as medium-term memory over dozens to hundreds of tokens, and some act as long-term knowledge storage. These networks are able to update themselves at…
saved by
related reading
- Why We Need Continual Learning | Andreessen Horowitza16z.com
- The Continual Learning Problemjessylin.com
- NL.pdfabehrouz.github.io
- What's so hard about continuous learning?seangoedecke.com
- AI 2027ai-2027.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- [2512.24695] Nested Learning: The Illusion of Deep Learning Architecturesarxiv.org
- What are the real problems of continual learning?infinitefaculty.substack.com
- Supermemory — Memory and continual learning for agentssupermemory.ai
- Announcing our investment in Engram, the memory dream team — Amplify Partnersamplifypartners.com
- Continual Learning in Token Space | Lettaletta.com
- Continual Learning: End of Frozen Software - Trajectorytrajectory.ai