flâneur

A Stargate for Data - by willdepue - Will DePue

willdepue.substack.com · 2,080 words · saved by 4 readers

What would a megaproject for data collection look like?

A Stargate for Data What would a megaproject for data collection look like? Jul 06, 2026 69 5 9 Share Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling revolution is a simple empirical law: deep neural networks improve smoothly, near magically, as you scale two things in proportion — (1) the size of the model and (2) the amount of data you train on. And despite the scaling laws being brutally d

saved by

related reading