✳flâneur — a map of the web's best reading
A Stargate for Data - by willdepue - Will DePue
willdepue.substack.com · 2,080 words · saved by 1 readers
What would a megaproject for data collection look like?
A Stargate for Data What would a megaproject for data collection look like? Jul 06, 2026 69 5 9 Share Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling revolution is a simple empirical law: deep neural networks improve smoothly, near magically, as you scale two things in proportion — (1) the size of the model and (2) the amount of data you train on. And despite the scaling laws being brutally d
Explore this link on the map →saved by
related reading
- will depue on X: "A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core x.com
- The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
- State of Data (Jan 2026)seancai.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
- A World of Verifiable Domainsseancai.com
- Unlocking a Million Times More Data for AI | IFPifp.org
- AI progress is about to speed up | Epoch AIepoch.ai
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- The Great Data Integration Schlep — LessWronglesswrong.com
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io