Subquadratic — Efficiency is Intelligence

Subquadratic is a frontier AI research and infrastructure company building a new class of LLMs.

Subquadratic — How SSA Makes Long Context Practical Research How SSA Makes Long Context Practical Date May 5, 2026 Updated May 15, 2026 Updated with recent third-party validated benchmarks from source Note: In this paper we share third-party verified benchmarks. A comprehensive model card is coming soon! SubQ is built around SSA, Subquadratic Sparse Attention, a linearly scaling attention mechanism designed for long-context retrieval, reasoning, and software engineering workloads. The core claim is simple: the hard problems enterprise AI needs to solve are long-context problems. Codebase, cont

saved by

• Varun Goyal
• 6051

related reading

• Subquadratic — Introducing SubQ: The First Fully Subquadratic LLMsubq.ai
• 2502.11089arxiv.org
• [2507.04239] Scaling Context Requires Rethinking Attentionarxiv.org
• On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
• A short note on some aspects of long context attention | nor's blognor-blog.pages.dev
• Recursive Language Models | Alex L. Zhangalexzhang13.github.io
• Linear Attention Fundamentals | Hailey Schoelkopfhaileyschoelkopf.github.io
• DeltaNet Explained (Part I) | Songlin Yangsustcsonglin.github.io
• H3: Language Modeling with State Space Models and (Almost) No Attention · Hazy Researchhazyresearch.stanford.edu
• [2506.06266] Cartridges: Lightweight and general-purpose long context representations via self-studyarxiv.org
• Extending Context is Hard | kaiokendevkaiokendev.github.io
• Overleaf Examplearxiv.org