flâneur

Designing Compute Markets | Kavish Garg

kavishgarg.com · 3,658 words · saved by 3 readers

A proposal for workload-native compute markets, forward auctions, spot pooling, and capacity markets.

We have been increasingly crunched for compute capacity over the past few months. Everyone, from early-stage startups to established hyperscalars, shares this sentiment . Market pricing does indeed reflect this narrative: the prices for 1-year H100 leases have risen 35% over the past four months. Amidst this capacity crunch, we have spontaneously seen market-making or brokering mechanisms emerge. From VC firms running compute pools to independent compute brokers slinging H100s, everyone has seemingly made “compute” an agenda. Many cloud aggregators are also working on compute allocation in a m

saved by

related reading