Designing Compute Markets | Kavish Garg

A proposal for workload-native compute markets, forward auctions, spot pooling, and capacity markets.

We have been increasingly crunched for compute capacity over the past few months. Everyone, from early-stage startups to established hyperscalars, shares this sentiment . Market pricing does indeed reflect this narrative: the prices for 1-year H100 leases have risen 35% over the past four months. Amidst this capacity crunch, we have spontaneously seen market-making or brokering mechanisms emerge. From VC firms running compute pools to independent compute brokers slinging H100s, everyone has seemingly made “compute” an agenda. Many cloud aggregators are also working on compute allocation in a m

saved by

• Aryan Naik
• Kamal Nayan Bandaru
• Ishan Mukherjee

related reading

• $2 H100s: How the GPU Bubble Burst - by Eugene Cheahlatent.space
• The Economics of Open-Weight Inferencedata.ornn.com
• AI Chip Architecturesjepeake.com
• The birth of the AI compute marketdavefriedman.substack.com
• Could Compute Become a Commodity? Lessons from Oil, Power, and Spectrumformvfunction.substack.com
• Volatility in the GPU rental market - by Neha Desarajuquantfutures.substack.com
• Why compute might get 10x more expensive in coming yearsdwarkesh.com
• Nvidia H100 GPUs: Supply and Demand · GPU Utils ⚡️gpus.llm-utils.org
• On Making a Trading Market for "Compute"ai-street.co
• The birth of GPU futuresdavefriedman.substack.com
• Clouded Judgement 7.3.26 - The End of Compute Scarcity? Not So Fastcloudedjudgement.substack.com
• On Commoditization, Pricing, and Assetsevanjconrad.com