LLMs as Parts of Systems - Marc's Blog
Over on the Kiro blog, I wrote a post about Kiro and the future of AI spec-driven software development, looking at where I think the space of AI-agent-powered development tools is going. In that post, I made a bit of cheeky oblique reference to a topic I think is super important. I asked Kiro to build a Towers of Hanoi game. It’s an oblique reference to Apple’s The Illusion of Thinking paper, and the discourse that followed it. The question of whether LLMs can scalably play Towers of Hanoi is an interesting theoretically and scientifically, but not the most important question. The more important one is can systems built with LLMs play these games?. By picking me Towers of Hanoi in that other post, I was pointing out that the answer is clearly yes. And has been for several LLM generations. As a system builder, I’m much more interested in what systems of LLMs and tools can do together. LLMs and code interpreters. LLMs and databases. LLMs and browsers. LLMs and SMT solvers. These systems
LLMs as Parts of Systems - Marc's Blog Marc's Blog About Me My name is Marc Brooker. I like to build things that work, and do cool stuff. I like building big things. I also dabble in machining, welding, cooking, and skiing. I am an engineer at Amazon Web Services (AWS) in Seattle, where I work on agentic AI, especially safety and policy for agentic AI. Before that, I worked on EC2, EBS, databases, serverless, and serverless databases. All opinions are my own. Links My Publications and Videos @marcbrooker on Mastodon @MarcJBrooker on Twitter Is this blog written by AI? LLMs as Parts of Systems
Explore this link on the map →related reading
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- Building Effective AI Agents \ Anthropicanthropic.com
- Building Effective AI Agents \ Anthropicanthropic.com
- AI Horseless Carriages | koomen.devkoomen.dev
- LLM Daydreaming · Gwern.netgwern.net
- Malleable software in the age of LLMsgeoffreylitt.com
- GenAI Handbookgenai-handbook.github.io
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- 2025: The year in LLMssimonwillison.net
- The bitter lesson of LLM evalsparsed.com
- The Future of Everything is Lies, I Guessaphyr.com
- The Shift from Models to Compound AI Systems – The Berkeley Artificial Intelligence Research Blogbair.berkeley.edu