✳flâneur — a map of the web's best reading
H-Nets - the Past | Goomba Lab
goombalab.github.io · 5,852 words · saved by 5 readers
Homepage of the Goomba AI Lab @ CMU MLD.
H-Nets - the Past | Goomba Lab H-Nets - the Past This post is part of a two-part series. H-Nets: the Past H-Nets: the Future [ Paper ] [ Code ] The H-Net model has been a dream of mine for years. I’ve been fortunate enough to be able to work with my student Sukjun Hwang who made the technical breakthroughs behind this model, solving (or at least making serious progress towards) what I consider to be a very difficult but foundational problem for deep learning. In this post, I provide an informal personal recounting of the motivation and history of this project, adding various context and discus
Explore this link on the map →saved by
related reading
- H-Nets - the Future | Goomba Labgoombalab.github.io
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- The Bitter Lesson is coming for Tokenization – ⛰️ lucalplucalp.dev
- H3: Language Modeling with State Space Models and (Almost) No Attention · Hazy Researchhazyresearch.stanford.edu
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- MambaByte: Token-free Selective State Space Modelarxiv.org
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Mamba: The Easy Wayjackcook.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- Thread by @karpathy on Thread Reader App – Thread Reader Appthreadreaderapp.com