How Long Contexts Fail | Drew Breunig
Taking care of your context is the key to building successful agents. Just because there’s a 1 million token context window doesn’t mean you should fill it.
Jun 22, 2025 AGENTS LLM AI PROMPTING CONTEXT MANAGEMENT How Long Contexts Fail Managing Your Context is the Key to Successful Agents As frontier model context windows continue to grow 1 , with many supporting up to 1 million tokens, I see many excited discussions about how long context windows will unlock the agents of our dreams. After all, with a large enough window, you can simply throw everything into a prompt you might need – tools, documents, instructions, and more – and let the model take care of the rest. Long contexts kneecapped RAG enthusiasm (no need to find the best doc when you ca
Explore this link on the map →saved by
related reading
- Introducing SWE-grep and SWE-grep-mini: RL for Multi-Turn, Fast Context Retrieval | Cognitioncognition.ai
- How to Fix Your Contextdbreunig.com
- Effective context engineering for AI agents \ Anthropicanthropic.com
- Context Engineering for AI Agents: Lessons from Building Manusmanus.im
- Don’t Build Multi-Agents | Cognitioncognition.ai
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Generalizing an LLM from 8k to 1M Context using Qwen-Agent | Qwenqwenlm.github.io
- Dynamic context discovery · Cursorcursor.com
- Recursive Language Models | Alex L. Zhangalexzhang13.github.io
- What is a context window? | IBMibm.com
- A Guide to Claude Code 2.0 and getting better at using coding agents – sankalp's blogsankalp.bearblog.dev
- Building reliable AI agents · parth sareenparthsareen.com