Scaling to 1 million concurrent sandboxes in seconds
x.com · 1,735 words · saved by 1 readers
https://t.co/tkQwK6erWw
This post was written by Colin Weld and Connor Adams. Read it here or on our blog. At Modal, we build sandboxes, among other things. Agents run in sandboxes, and agents are eating software. Today, Modal runs millions of sandboxes per day, supports up to fifty thousand concurrent sandboxes per customer, and supports a variety of use cases at scale, from reinforcement learning to background agents. Increasingly, our users require more and more sandboxes, created at higher and higher rates. Reinforcement learning can require running millions of sandboxes concurrently, and creating bursts of…
saved by
related reading
- Lee Robinson (@leerob) on Xx.com
- Low Latency and Model Training at Modalrhea24.github.io
- Agent swarms and the new model economics · Cursorcursor.com
- Towards self-driving codebases · Cursorcursor.com
- Modal: High-performance AI infrastructuremodal.com
- Modal's serverless Servers | Modal Blogmodal.com
- Report: Modal Business Breakdown & Founding Story | Contrary Researchresearch.contrary.com
- Hidden Technical Debt of AI Systems: Agent Runtimeleehanchung.github.io
- Joining Modaladamazzam.com
- Scaling long-running autonomous coding · Cursorcursor.com
- Introductionmodal.com
- Scaling Managed Agents: Decoupling the brain from the hands \ Anthropicanthropic.com