Home | infini-gram
Join our Discord server! Get the latest updates & maintenance announcements, ask the developer anything about infini-gram, and connect with other fellow users.
📖 Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens Jiacheng Liu 1 , Sewon Min 1 , Luke Zettlemoyer 1 , Yejin Choi 1,2 , Hannaneh Hajishirzi 1,2 1 University of Washington, 2 Allen Institute for AI [ Web Interface ] [ API Endpoint ] [ Python Package ] [ Docs ] [ Code ] [ Paper ] [✨NEW] Check out infini-gram mini , a more storage-efficient index based on FM-index, with similar functionalities as infini-gram. [✨NEW] Check out OLMoTrace , an LLM behavior tracing tool we developed on top of infini-gram. Join our Discord server ! Get the latest updates & maintenance announ
saved by
related reading
- Let Your Graph Do the Talking: Encoding Structured Data for LLMsarxiv.org
- Recursive Language Models | Alex L. Zhangalexzhang13.github.io
- Language Modeling Without Neural Networksnathan.rs
- Deep Dive into LLMs like ChatGPTyoutube.com
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- GitHub - Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Modelgithub.com
- Unlimiformer: Long-Range Transformers with Unlimited Length Inputarxiv.org
- Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
- [2509.14786] Pre-training under infinite computearxiv.org
- Efficient Guided Generation for Large Language Modelsarxiv.org
- Unlimiformer: Long-Range Transformers with Unlimited Length Inputarxiv.org
- [2403.06664] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real Systemarxiv.org