✳flâneur — a map of the web's best reading
Subquadratic — Introducing SubQ: The First Fully Subquadratic LLM
subq.ai · 1,092 words · saved by 1 readers
Subquadratic is a frontier AI research and infrastructure company building a new class of LLMs.
Subquadratic — Introducing SubQ: The First Fully Subquadratic LLM Product Introducing SubQ: The First Fully Subquadratic LLM By Justin Dangel, co-founder and CEO, Subquadratic Date May 5, 2026 Transformers defined the last decade of AI — the "T" in ChatGPT. They unlocked modern language understanding, reasoning, and much of what we now think of as AI. Yet one fundamental limitation has shaped everything built on top of them: compute requirements scale quadratically with context length. In practice, longer inputs don't reliably improve how well a model uses the information provided. As context
Explore this link on the map →saved by
related reading
- Subquadratic — How SSA Makes Long Context Practicalsubq.ai
- On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
- GenAI Handbookgenai-handbook.github.io
- Recursive Language Models | Alex L. Zhangalexzhang13.github.io
- My picture of the present in AI — LessWronglesswrong.com
- [2507.04239] Scaling Context Requires Rethinking Attentionarxiv.org
- Memory makes computation universal, remember?thinks.lol
- LLM Inference Performance Engineering: Best Practices | Databricks Blogdatabricks.com
- 2025: The year in LLMssimonwillison.net
- Getting Caught Up to Modern LLM Research | Samarth Goeldev.samarthgoel.com
- Reiner Pope – The math behind how LLMs are trained and serveddwarkesh.com
- I am worried about near-term non-LLM AI developments — LessWronglesswrong.com