Dynamic Chunking for End-to-End Hierarchical Sequence Modeling
arxiv.org · 7,303 words · saved by 1 readers
N/A
Dynamic Chunking for End-to-End Hierarchical Sequence Modeling Sukjun Hwang Brandon Wang Carnegie Mellon University Cartesia AI sukjunh@cs.cmu.edu brandon.wang@cartesia.ai Albert Gu…
saved by
related reading
- H-Nets - the Past | Goomba Labgoombalab.github.io
- H-Nets - the Future | Goomba Labgoombalab.github.io
- The Bitter Lesson is coming for Tokenization – ⛰️ lucalplucalp.dev
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- dnaHNet: A Scalable and Hierarchical Foundation Model for Genomic Sequence Learningarxiv.org
- frontier model training methodologies | Alex Wa's Blogdjdumpling.github.io
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- You Can Learn Tokenization End-to-End with Reinforcement Learningarxiv.org
- Seq2seq and Attentionlena-voita.github.io
- MambaByte: Token-free Selective State Space Modelarxiv.org
- [2112.10508] Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLParxiv.org
- 2025.acl-long.453.pdfaclanthology.org