A Stargate for Data - by willdepue - Will DePue

What would a megaproject for data collection look like?

A Stargate for Data What would a megaproject for data collection look like? Jul 06, 2026 69 5 9 Share Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling revolution is a simple empirical law: deep neural networks improve smoothly, near magically, as you scale two things in proportion — (1) the size of the model and (2) the amount of data you train on. And despite the scaling laws being brutally d

saved by

• Dheera Vuppala
• Aryan Naik
• alana goyal

related reading

• will depue on X: "A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core x.com
• A Stargate for Datawilldepue.substack.com
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Everett Randle (@EverettRandle) on Xx.com
• The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
• Ilya Sutskever — We're moving from the age of scaling to the age of researchdwarkesh.com
• There Are No New Ideas in AI… Only New Datasetsblog.jxmo.io
• State of Data (Jan 2026)seancai.com
• AI Is Slowing Downwheresyoured.at
• Will scaling work?dwarkeshpatel.com
• Dario Amodei — "We are near the end of the exponential"dwarkesh.com
• Data bottlenecks won’t prevent an intelligence explosionnewsletter.forethought.org